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This  report  makes  several  contributions.  First,  an  approach  is  developed  to 
synthesize  multichannel  autoregressive  CAR)  random  processes  allowing  for  the  control 
of  temporal  and  cross-channel  correlation  of  the  processes  subject  to  specific  con¬ 
straints  for  realizable  correlation  sequences.  Second,  analytic  expressions  are 
developed  for  the  error  variance  of  time-averaged  correlation  function  estimators  for 
discrete,  complex  baseband  processes.  These  expressions  reveal  the  functional  depen¬ 
dence  of  the  error  variance,  not  only  on  the  window  size  of  the  observation  interval, 
but  also  on  fundamental  characteristics  of  the  observed  processes.  Third,  model-based 
likelihood  ratios  are  developed  for  the  multichannel  binary  detection  problem  using 
error  veccor  processes  obtained  through  predictional  error  filtering  operations.  These 
ratios  are  derived  assuming  wide-sense  stationarity  of  the  baseband  Gaussian  processes. 
However,  a  more  general  likelihood  ratio  applicable  for  nonstationary  bandpass  processe 
is  also  developed.  Fourth,  the  more  general  likelihood  ratio  utilized  a  more  powerful 
estimator  than  previously  noted.  This  estimator  is  capable  of  whitening  not  only  the 
complex  observation  processes,  but  also  their  quadrature  components.  Furthermore,  we 
point  out  that  coefficients  for  this  more  general  linear  estimator  could  be  obtained 
using  the  same  form  as  algorithms  proposed  for  wide-sense  jointly  scationary  complex 
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CHAPTER  1  INTRODUCTION 


1.1.  Background 

The  detection  problem  for  a  known  deterministic  signal  in  additive 
Gaussian  noise  has  been  solved  using  a  correlator  or  matched  filter  [46,55,43,19 
Part  I].  For  the  case  of  a  random  signal  in  white  noise,  a  two  stage  process  is 
utilized  which  first  estimates  the  signal  and  then  correlates  this  estimate  with  the 
received  waveform.  This  detection  scheme  is  referred  to  as  the  estimator- 
correlator  [48-51,53,19  Part  III].  The  advantage  of  this  latter  approach  is  its 
practical  implementation  structure  as  well  as  its  intuitive  justification  in  that  the 
best  obtainable  estimate  of  the  signal  is  used  in  the  correlation  stage.  As  noted  by 
Kailath  [54],  however,  the  estimator-correlator  method  described  in  [51]  fails 
when  the  signal  and  noise  are  correlated.  These  limitations  were  overcome  for 
continuous-time  processes  by  Kailath  [53,56]  using  the  innovations  representation. 
In  addition,  the  approach  based  on  innovations  representations  can  be  applied  to 
non-Gaussian  signal  processes.  This  detection  problem  is  expressed  as 

H0:  x(t)  =  w(t)  0<£t<ST  (1.1.1a) 

H,:  x(t) « s(t)  +  w(t)  0  £  t  £  T  (1.1.1b) 

where  T  is  the  observation  interval  and  Hj  i=0,l  are  the  hypotheses  corresponding 

to  signal  absent  and  present,  respectively;  s(t)  is  the  (not  necessarily  Gaussian) 
random  signal  and  w(t)  is  Gaussian  white  noise.  Under  Hj,  the  optimal  minimum 

mean-squared  error  (MMSE)  causal  estimate  of  s(t)  is 

s(t)  =  E  [s(t)l  x(t’),  t'  <  t].  (1.1.2) 

Using  the  definition  of  the  innovations  [57];  ie. 

v(t)  =  x(t)  •  s(t),  (1.1.3) 

the  innovations  theorem  for  continuous-time  processes  (ie.  the  covariance  of  v(t) 
and  w(t)  are  identical),  and  the  property  that  v(t)  is  Gaussian  if  w(t)  is  Gaussian 
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[53],  Kailath  transformed  the  detection  problem  of  eq  (1.1.1)  to  the  equivalent 
detection  problem: 

H0:  x(t)  =  v(t)  0  <i  t  <1  T.  (1.1.4a) 

Hj:  x(t)  =  s(t)  +  v(t)  0  £  t  £  T  (1.1.4b) 

In  this  form  of  the  detection  problem,  s(t)  is  viewed  as  a  conditionally-known 
signal.  In  [53],  it  was  shown  that  the  likelihood  ratio  for  the  problem  defined  in 
eqs(1.1.4)  has  the  same  form  as  the  estimator-correlator  for  the  Gaussian  signal 
in  the  white  Gaussian  noise  case.  Although  this  likelihood  ratio  was  derived 
assuming  s(t)  and  w(t)  as  statistically  independent,  this  restriction  was  later 
[56,58]  relaxed  to  include  the  situation  where  the  signal  could  be  correlated  with 
past  noise.  It  is  interesting  to  note  that  the  innovations  approach  does  not  use  a 
Karhunen-Loeve  expansion  which  requires  s(t)  and  w(t)  to  be  statistically 
independent.  This  latter  generalization  by  Kailath  [56,58]  indicates  that  the 
innovations  approach  may  offer  a  robustness  in  detection  problems  involving 
feedback,  multipath,  etc. 

Unlike  the  continuous-time  case,  discrete  innovations  processes  are  not 
necessarily  Gaussian  unless  both  w(t)  and  $(t)  are  Gaussian.  In  addition,  the 
covariance  of  the  innovations  is  not  equivalent  to  that  of  the  white  noise  [53,57]. 
Thus,  the  likelihood  ratio  for  the  discrete  time  case  can  not  be  computed  using  the 
estimator-correlator  structure.  For  this  case,  a  likelihood  ratio  using  discrete- 
time  innovations  processes  was  developed  [14,  24].  In  [14],  it  is  shown  for  non- 
Gaussian  processes  that  this  likelihood  ratio,  called  the  Innovations-Based 
Detection  Algorithm  (IBDA),  asymptotically  approaches  the  likelihood  ratio  for 
the  Gaussian  problem.  The  approximation  is  due  to  the  use  of  the  Central  Limit 
Theorem,  so  that  an  asymptotic  approximation  is  obtained  using  a  large  number 
of  data  samples.  Furthermore,  the  structure  of  the  likelihood  ratio  is  obtained  by 
assuming  a  specific  parametric  model  of  the  observation  processes  for  each 
hypothesis  and  by  designing  a  prediction  error  filtering  stage  for  each.  Adaptive 
algorithms  are  then  used  to  estimate  the  unknown  model  parameters.  Since  the 
order  of  the  model  under  H1  is  usually  assumed  to  be  greater  than  that  under  Hq 

(and  with  distinct  coefficients)  the  filter  Fj  designed  for  the  hypothesis  H,  data  is 
of  larger  order  than  the  filter  F0  designed  for  the  hypothesis  Hq  data.  Thereto,  e, 
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the  error  output  from  the  F0  filter  given  that  H,  is  true  will  be  greater  than  the 
error  output  from  the  filter  designed  for  Hj.  These  error  differences  are  used  in 
the  computation  of  the  likelihood  ratio  to  increase  or  decrease  its  value  relative  to 
the  threshold  level.  In  [40],  it  is  shown  that  this  likelihood  ratio  is  a 
generalization  of  several  important  special  cases.  These  include  (1)  the  detection 
of  a  deterministic  signal  in  additive  white  Gaussian  noise,  (2)  the  detection  of  a 
non-white  Gaussian  signal  process  in  additive  white  Gaussian  noise,  (3)  the 
moving  target  detection  (MTD)  algorithm  for  the  detection  of  a  deterministic 
signal  in  non-white  Gaussian  noise  [41,42]  and  (4)  the  detection  of  a  non- white 
Gaussian  signal  process  in  additive  non-white  Gaussian  noise  [43].  It  is  also 
shown  [40]  that  the  IBDA  reduces  to  the  algorithm  developed  [44]  for  the 
detection  of  a  deterministic  signal  in  additive  non-white  Gaussian  noise  of 
unknown  correlation  statistics.  An  experimental  investigation  using  two 
implementations  of  the  IBDA  was  conducted  in  [16]  for  an  airport  surveillance 
radar  application  and  performance  comparisons  made  with  three  MTD 
algorithms. 

Several  early  analyses  involving  model-based  parametric  detection 
approaches  are  presented  in  [81,45,43,62]  where  the  original  pioneering  work 
appears  to  be  presented  by  Schweppe  in  [1],  Most  of  the  interest,  however, 
appears  to  have  taken  place  within  the  past  few  years 
[14,16,20,23,24,44,46,61,80,82].  The  principal  advantage  of  characterizing  the 
observation  processes  for  each  hypothesis  via  a  parametric  model  is  that  well 
known  algorithms  can  be  utilized  to  estimate  the  parameters.  In  [46],  a  likelihood 
ratio  test  was  considered  for  two  known  autoregressive  (AR)  models.  In  [82],  a 
more  general  formulation  considers  AR  and  autoregressive-moving  average 
(ARMA)  models  to  detect  a  Gaussian  signal  in  white  Gaussian  noise,  both  with 
unknown  statistics.  Thus,  the  IBDA  [14,24]  mentioned  above  considers  the  more 
general  detection  problem  of  a  non-Gaussian  signal  in  non-white  plus  white  noise. 
As  noted  in  [83],  however,  different  modeling  approaches  will  generally  yield 
differences  in  receiver  performance.  In  addition,  the  problem  of  modeling 
observation  processes  in  this  detection  scheme  is  more  difficult  than  model-fitting 
a  time  series  process.  This  is  due  to  the  fact  that  one  set  of  observation  data  is 
given  in  the  detection  problem,  and  the  problem  is  to  determine  which  of  the  two 
filters  is  estimating  the  parameters  properly.  In  [20,83],  Zhang  investigated  the 
detection  performance  improvement  over  the  IBDA  [24]  in  a  radar  application, 
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when  'a  priori'  information  was  used  to  predetermine  the  process  parameters; 

specifically,  a  reference  channel  which  provided  data  from  range  cells  adjacent  to 
the  "test  cell"  was  used  to  determine  the  filter  coefficients  under  Hq.  A  significant 

detection  performance  improvement  over  the  IB  DA  was  reported.  It  thus  appears 
that  performance  improvements  can  be  made  in  the  model-based  detection 
schemes  through  investigarions  of  alternative  algorithms  and  implementation 
schemes  for  the  detectr  .1  problem  with  unknown  statistics. 

In  development  of  the  model-based  detection  approaches,  the  emphasis  is 
placed  on  characterizing  the  observation  data  received  under  each  hypothesis  with 
approximate  modek.  If  the  models  fail  to  fit  the  physical  processes,  performance 
degradations  will  result.  Model  fitting  of  observation  data  via  time  series  analysis 
has  received  considerable  attention  [26,27,30,31,36,63-67].  Multichannel  time 
series  analyses  have  also  been  investigated  [28,30,3 l,35,64(PartII),65, 67]  with 
emphasis  in  the  areas  of  geophysics,  biophysics  and  economics.  Furthermore, 
multichannel  algorithms  for  parameter  estimation  have  received  some  attention 
[6,7,8,10,17,59,60].  However,  the  multichannel  model  fitting  problem  remains 
an  open  area  for  future  research.  In  particular,  a  requirement  for 
computationally  efficient  and  numerically  stable  multichannel  algorithms  remains 
as  does  a  requirement  for  a  multichannel  model  order  selection  criterion. 
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1.2  Research  Objectives  and  Approach 

This  dissertation  considers  the  binary  multichannel  detection  problem  for  a 
random  signal  vector  in  additive  non-white  interference  plus  white  Gaussian  noise 
using  a  model-based  approach.  The  observation  processes  are  allowed  to  have 
partial  correlation  in  time  and  space  (ie.  across  the  channels).  The  principal 
research  objective  is  the  investigation  of  multichannel  model-based  detection 
methods  to  determine  their  performance  relative  to  the  single  channel  case.  The 
model-based  approach  considers  the  underlying  processes  to  be  characterized  by 
parametric  models  [such  as  the  autoregressive(AR)  description]  and  implements  a 
likelihood  ratio  which  is  sensitive  to  the  differences  between  the  estimated  model 
parameters  under  each  hypothesis.  Specifically,  we  give  prime  consideration  to 
multichannel  autoregressive  processes  [7-10,17,28,29]  as  the  underlying  process 
model  descriptions  in  the  proposed  investigation.  Thus,  the  model-based 
approach  is  based  on  the  contention  that  the  coefficients  of  the  received  processes 
are  distinct  for  each  of  the  two  hypotheses  (i.e.,  signal  present  or  absent). 
Decision,  therefore,  is  based  upon  measures  which  are  sensitive  to  the  differences 
in  the  process  coefficients  for  each  hypothesis. 

The  detection  procedure  which  is  developed  and  analyzed  here  establishes  a 
method  capable  of  processing  observation  data  from  'distinct'  multiple  sources 
each  containing  information  regarding  the  presence  or  absence  of  the  signal.  The 
term  'distinct'  is  used  here  to  indicate  that  the  channel  processes  may  be 
dissimilar  in  terms  of  the  methods  used  to  observe  them.  However,  the  basic 
assumption  is  that  these  processes  can  be  related  by  a  multichannel  time  series 
model;  ie.,  the  underlying  physical  mechanisms  giving  rise  to  the  observed 
random  processes  obtained  under  each  hypothesis  can  be  represented  by  a 
mathematical  model  which  approximates  its  statistical  characteristics.  Thus,  the 
applicability  of  multichannel  time  series  models  and  the  performance  of 
multichannel  parameter  estimation  algorithms  to  the  detection  problem 
considered  here  is  an  important  area  for  further  investigation.  The  emphasis  in 
the  analysis  presented  here  is  the  development  of  multichannel  model-based 
detection  approaches  and  their  assessment  for  improved  detection  performance 
over  that  of  the  single  channel  case.  The  extraction  of  this  additional  information 
is  achieved  by  removing  the  redundant  (i.e.  correlated)  information  from  the 
observation  data.  This  is  achieved  via  estimation  methods  which  "whiten"  the  data 
in  time  and  space  (i.e.,  channels).  The  resulting  uncorrelated  error  residual 
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processes  contain  all  the  useful  or  'new'  information  about  the  processes  in  a 
compact  form  and  are  utilized  to  determine  a  sufficient  statistic  for  hypothesis 
selection.  As  shown  in  chapter  6,  these  processes  enable  one  to  efficiently 
perform  a  calculation  of  the  likelihood  ratio.  In  addition,  the  likelihood  ratio 
considered  here  has  an  implementation  framework  amenable  to  adaptive 
processing  methods.  Furthermore,  the  detection  procedure  accounts  for  the 
temporal  and  cross-channel  correlation  of  the  signal  and  clutter  processes  and 
thus  provides  coherent  detection  over  multiple  observations  both  in  time  and 
across  channels.  Also,  no  restrictive  assumptions  are  made  regarding  correlation 
between  the  signal  and  clutter  processes.  As  a  result,  the  detection  method  should 
retain  considerable  robustness  in  detection  problems  involving  feedback  or  radar 
multipath  conditions  [21,40].  In  this  dissertation,  multichannel  likelihood  ratios 
are  first  developed  foi  jointly  stationary,  complex,  Gaussian  baseband  processes 
which  also  have  stationary  bandpass  processes.  However,  a  likelihood  ratio  for  a 
class  of  processes  with  more  generally  correlated  Gaussian  quadrature 
components  is  also  developed.  These  latter  processes  are  not  restricted  to  have 
stationary  bandpass  processes. 

In  addition  to  the  likelihood  ratio  implementation,  an  approach  has  been 
developed  for  the  synthesis  of  multichannel  autoregressive  (AR)  random 
processes.  The  procedure  allows  for  variable  temporal  and  cross-channel 
correlation  properties  subject  to  specific  constraints  for  correlation  functions. 
The  resulting  synthesized  processes  provide  a  Tit'  in  a  minimum  mean  squared 
error  (MMSE)  sense  to  the  correlation  functions  which  are  specified  in  terms  of 
temporal  and  cross-channel  correlation  parameters  of  the  processes.  Computer 
simulation  results  are  presented  showing  the  case  of  a  two  channel  AR  process 
with  various  temporal  and  cross-channel  correlation.  A  method  is  also  suggested 
to  generalize  the  synthesized  outputs  to  obtain  complex  processes  with  jointly 
Gaussian  quadrature  components  where  the  usual  assumptions  associated  with  a 
complex  Gaussian  process  are  relaxed.  These  processes  provide  an  input  to  the 
likelihood  ratio  architectures  to  obtain  detection  performance  as  a  function  of 
channel  signal-to-noise  ratio  as  well  as  the  process  correlation  parameters. 

As  a  third  contribution,  ergodicity  considerations  are  used  to  develop 
analytic  expressions  for  the  variance  of  the  time-averaged  auto-  and  cross-channel 
correlation  function  estimators  for  discrete,  complex  processes.  These 
expressions  provide  a  performance  measure  which  can  be  used  to  specify  the 
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window  size  of  the  observation  interval  required  to  achieve  a  specific  value  of 
this  variance.  A  unique  aspect  of  this  development  is  the  determination  of  the 
functional  dependence  of  these  expressions  in  terms  of  the  process  characteristics 
such  as  their  variances  as  well  as  their  temporal  and  cross-channel  correlations. 
In  addition,  the  analytic  expressions  are  developed  for  the  general  case  of 
complex  processes  with  jointly  Gaussian  quadrature  components  where  the  usual 
assumptions  associated  with  a  complex  Gaussian  process  are  relaxed.  Validity  of 
the  analytic  expressions  is  presented  using  the  multichannel  process  synthesis 
method  noted  above.  This  analysis  is  of  particular  significance  for  the  case  of 
'unknown'  process  parameters  where  the  generalized  likelihood  ratio  is  evaluated 
using  parameter  estimation  algorithms  based  on  time-averaging  methods.  In  this 
case,  detection  performance  limits  result  due  to  the  eivors  associated  with  the 
time-averaged  estimates. 

Finally,  the  multichannel  approach  addressed  here  is  applicable  in  a  wide 
range  of  detection  problems.  Examples  of  application  areas  can  be  found  in 
radar  technology,  biomedical  applications,  geophysical  research,  image 
processing,  data  compression,  speech  analysis  and  channel  equalization.  A 
significant  contribution  of  the  detection  algorithm  considered  here  is  the 
*  capability  to  utilize  signal  processing  procedures  to  deal  with  partially  correlated 
observation  data.  For  the  active  radar  case,  we  view  the  multichannel 
observation  data  as  processes  which  arise  through  a  simultaneous  excitation  of  the 
surveillance  volume  with  a  multiplicity  of  waveforms.  For  passive  detection 
applications,  we  view  the  processes  as  arising  from  internal  physical  mechanisms 
which  give  rise  to  the  emission  of  radiation  which  may,  in  general,  contain  partial 
correlation  when  observed  over  specific  bands.  In  biomedical  applications,  we 
might  consider  the  processing  of  EEG  waves  where  we  may  seek  to  detect  a  weak 
brain  potential  among  other  brain  signals.  For  the  purpose  of  validating  the 
theoretical  results  developed  here,  performance  evaluations  are  carried  out  in 
terms  of  receiver  operating  characteristics.  Both  analytic  as  well  as  Monte  Carlo 
approaches  are  utilized  in  the  analysis. 

In  chapter  2.0,  we  review  multichannel  linear  filtering  and  estimation 
methods  which  are  used  in  the  implementation  of  the  detection  methods  used  in 
this  dissertation.  The  detection  problem  is  defined  in  chapter  3.0.  In  chapter  4.0, 
we  present  a  novel  method  for  the  synthesis  of  multichannel  random  processes 
composed  of  additive  signal,  non-white  (clutter)  and  white  noise  processes.  Both 
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the  signal  and  non-white  clutter  interference  are  characterized  as  random  vector 
processes  using  multichannel  autoregressive  (AR)  processes.  In  addition,  the 
method  enables  one  to  control  the  correlation  and  variances  of  these  processes 
both  in  time  and  across  channels.  Thus,  the  method  provides  a  means  for  the 
generation  of  input  observation  processes  for  the  detection  algorithm  in  which 
parameters  such  as  the  temporal  and  cross-channel  correlation  as  well  as  the 
signal-to-noise  (S/N)  and  clutter-to-noise  (C/N)  ratios  can  be  varied.  In  chapter 
5.0,  expressions  for  the  variance  of  time-averaged  estimators  are  presented. 
These  results  are  derived  to  demonstrate  the  detection  performance  limits  which 
result  due  to  the  errors  associated  with  these  estimates.  Likelihood  ratios  for  the 
detection  problem  with  wide-sense  stationary,  Gaussian  signal  and  interference 
processes  are  developed  in  chapter  6.0.  In  addition,  implementation  architectures 
for  these  likelihood  ratios  are  presented.  In  chapter  7.0,  we  describe  the 
procedure  used  to  determine  detection  performance.  Specifically,  the  Monte- 
Carlo  method  is  described  under  the  conditions  where  the  statistics  of  the 
underlying  processes  are  assumed  to  be  ’known’  and  'unknown'.  In  one  of  the 
appendices,  we  present  a  review  of  detection  using  multiple  observations  with  an 
extension  to  the  multichannel  case.  We  also  consider  the  two  cases  where  the 
signal  processes  are  totally  correlated  and  uncorrelated,  respectively,  in  time  and 
across  channels.  These  two  cases  are  shown  to  bound  the  partially  correlated 
signal  in  white  noise  detection  results  presented  and  thus  provide  an  analytic 
assessment  to  validate  the  results  presented  here.  Finally,  in  chapter  8,  we 
present  a  summary  of  the  conclusions  and  recommendations  for  future 
considerations. 
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CHAPTER  2  REVIEW  OF  LINEAR  FILTERING  AND 
ESTIMATION  ALGORITHMS 


In  this  chapter,  we  derive  the  mathematical  description  for  several 
important  linear  prediction  error  filters  (PEF).  These  include  the  multichannel 
forward  and  backward  prediction  error  filters  which  utilize  a  transversal  (tapped 
delay  line)  structure  as  well  as  the  multichannel  lattice  filter.  In  chapter  6,  these 
filtering  operations  are  used  in  the  implementation  architectures  /or  the 
multichannel  likelihood  ratios.  Initially,  however,  we  present  a  preliminary 
discussion  of  the  complex  processes  which  we  consider  in  this  dissertation.  These 
include  the  autoregressive  (AR)  processes  which  provide  a  parametric  discription 
of  the  processes.  Finally,  we  present  a  derivation  of  the  Levinson-Wiggins- 
Robinson  and  the  Strand-Nuttal  algorithms.  These  algorithms  can  be  used  to 
obtain  estimates  of  the  AR  process  parameters  using  the  observation  data.  In  this 
dissertation,  however,  the  Strand-Nuttal  algorithm  is  used  to  provide  the 
estimates  of  these  AR  parameters  which  in  turn  are  used  to  set  the  weights  in  the 
prediction  error  filters  discribed  in  chapter  6.  Whereas,  the  Levinson-Wiggins- 
Robinson  algorithm  is  used  in  a  process  synthesis  procedure  described  in  chapter 
4. 

2.1  DEFINITION  OF  THE  OBSERVATION  PROCESS 

Consider  the  complex  Gaussian  vector  process  &(n)  such  that 

&(n)  *  s(n)  +  £(n)  +  w(n)  n  =  1,2,...,N  (2.1.1) 

where  &(n)  is  a  discrete,  zero  mean,  wide-sense  jointly  stationary  Jxl  received 
baseband  observation  vector  consisting  of  observations  from  J  channels  and  $(n), 
£(n)  and  jy.(n)  are  zero  mean,  complex  Gaussian  random  Jxl  vector  processes 
describing  the  signal,  non-white  interference  (clutter)  and  white  noise, 
respectively.  The  vector  processes  s(n)  and  £(n)  individually  contain  an  arbitrary 
correlation  in  time  and  between  channels.  In  addition,  correlation  can  be 
considered  between  $(n)  and  past  values  of  £(n)  and  w(n).  We  will  consider  this 
point  further  in  chapter  3.  The  white  noise  vector  ^.(n)  is  uncorrelated  with 
itself  in  time,  but  not  necessarily  across  channels,  so  that 
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£[ffi(n)wH(k)J  = 


[0] 


ww 


(0) 


n^k 

n=k 


(2.1.2) 


where  Rww(0)  is  the  JxJ  correlation  matrix  of  ^(n).  The  notation  H  denotes  the 


Hermitian  operation;  ie.,  the  complex  conjugate  transpose.  The  NxN  correlation 
matrix  for  the  observation  data  is  expressed  as 


[R  Jn  = 

(2.1.3) 

where 

Sl.N  =  UT(1)  *T(2)...2tT(N)] 

(2.1.4a) 

and 

(2.1.4b) 

iT(k)  =  [xj(k)  x2(k)...Xj(k)]. 

Under  the  condition  of  wide-sense  stationarity,  [RJn  is  a  Hermitian,  positive 
semi-definite  matrix  [3].  Furthermore,  this  matrix  can  be  written  in  block  form 
as 


-  Rxx(0)  Rxx(-1) 

...  RjojC-N+I)- 

'  R>> 

R^x(l)  . 

Rxx<D  Rxx<0) 

...  Rxx(-N+2) 

= 

R«<-» 

0» 

..  Rxx(N-2) 

_R«(N-l)R«(N-2) 

...  Rxx(0)  _ 

_rJx(-N+1)rJx(-N+2) 

..  Rxx(0)  _ 

(2.1.5) 


where 

Rxx(D  -E  [*(k)xH(k-0]  k  =  1,2 . N 

I  =0,  ±  1,...,±  (N-l)  (2.1.6) 

and  the  last  expression  in  eq(2.1.5)  results  because  Rxx(0=:Rxx^"^‘  ^  *s  note<*’ 

however,  that  for  WO,  the  block  matrices  of  [R^In  are  not*  *n  general, 

Hermitian;  i.e.,  Rxx(l)*Rxx(l)  for  MO.  Note  that  (Rm)n  is  written  in  block  form 

where  each  block,  as  defined  in  eq(2.1.6),  is  a  JxJ  correlation  matrix  over  the  J 
channels.  We  also  note  that  [RM]N  is  block  Toeplitz.  This  property  is  utilized  in 

recursive  algorithms  to  solve  equations  involving  [Rxx1n« 
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2.2.  DEFINITION  OF  THE  AUTOREGRESSIVE  (AR)  PROCESS 

In  this  analysis,  the  multichannel  signal  and  non-white  clutter  vector 
processes  denoted  as  a(n)  and  £(n),  respectively,  are  modeled  as  multichannel 
forward  autoregressive  (AR)  processes;  ie.,  the  multichannel  Jxl  vector  g(n)  with 
g=s,c  is  expressed  as 


&(n)  «  -  Z  A  g  (k)&(n-k)  +  ug(n)  g  =  s,c  (2.2. 1 ) 

k=l 

u 

where  Ag  (k)  is  the  kth  JxJ  matrix  coefficient  for  AR  process  £(n)  of  model  order 
Mg  and  Hg(n)  is  the  Jxl  forward  white  noise  driving  vector  with  covariance 

u 

matrix  [F.f]u  .  We  note  that  Ag  (k)  is  expressed  in  terms  of  the  Hermitian 

operation  for  notational  convenience,  but  is  not  treated  here  as  a  Hermitian 
matrix.  It  will  be  shown  later  that  this  notation  enables  us  to  express  the  Yule- 

Walker  equation  [eq(2.5.5)]  in  terms  of  row  vectors  containing  the  Hermitian 
transpose  operation.  The  vectors  Ug(n)  from  eq(2.2.1)  and  ^.(n)  from  eq(2.1.1) 

can  be  expressed  as 


ULg(n)  =  Cv  vg(n)  g  =  s,c  (2.2.2a) 

o 

and 

yt(n)  =  CwYw(n)  (2.2.2b) 

where  y.g(n)  and  y.w(n)  are  white  noise  vectors  with  JxJ  diagonal  covariance 
matrices  Dv  and  the  identity  matrix  I,  respectively.  Eqs(2.2.2)  enable  us  to 

obtain 


[Sf]  s E[Ug(n)Ug(n)]  =  E(CV  vg(n)vg (n)Cv* ) 

o  o 

g  =  S,c 

(2.2.3a) 

H  H 

=  Cv  E[vg(n)vg  (n)]CVg 

g  =  S,C 

(2.2.3b) 

H 

=  CvgDvgCvg 

g  =  S,c 

(2.2.3c) 

and 
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Rww(0)  s  E[iK(n)ffiH(n))  =  E[Cwiw(n)j£(n)c5J]  (2.2.4a) 

=  CwE[iw(n)Y*(n)]Cw  (2.2.4b) 

=  Cwc“.  (2.2.4c) 

For  the  special  case 

Dv  =  E[yg(n)i-g(n)]  =  I  g  =  s,c  (2.2.5) 

© 

eq(2.2.3c)  reduces  to 

[If]  =  C  C?g.  (2.2.6) 

p  o 


We  will  discuss  the  implications  of  eq(2.2.5)  in  section  4.6.  Eqs(2.2.4c) 

and  (2.2.6)  indicate  that  the  JxJ  matrices  Cw  and  Cv  can  be  obtained  by  the 

s 

Cholesky  decomposition  of  Rww(0)  and  [Sf]u  ,  respectively.  These  relationships 

s 

will  be  utilized  in  the  process  synthesis  procedure  described  in  chapter  4. 
Alternatively,  eq(2.2.2a)  could  have  been  expressed  as 

Ug(n)  =  Lz  zg(n)  g  =  s,c  (2.2.7) 

o 

where  Lz  is  a  unit  diagonal  lower  triangular  matrix  and  the  vector  process  £g(n) 

o 

is  a  white  noise  vector  uncorrelated  in  time,  whose  components  are  also 
uncorrelated  across  channels.  The  covariance  matrix  of  ug(n)  is  expressed  as 


[2f]0g  =  E[ug(n)i£(n)]  =  E(LZ  zg(n)^(n)L2g) 

g  =  s,c 

(2.2.8a) 

H  H 

=  Lz  E[ig(n)ig  (n)]Lz 

O  o 

g  =  S,c 

(2.2.8b) 

H 

— -  L7  D7  L? 

Zg  Zg  Zg 

g  =  S,c 

(2.2.8c) 
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where 


D,  =  E[2g(n)^(n)].  (2.2.9) 

© 

Eq(2.2.8c)  denotes  the  LDLH  decomposition  of  [If]u  provided  Dz  is  a 

8  8 

real,  diagonal  matrix.  Furthermore,  the  channel  variances  are  contained  along 
the  diagonal  elements  of  Dz^. 


2.3.  THE  YULE-WALKER  EQUATIONS 


In  this  section,  we  present  the  relationship  between  the  matrix  coefficients 
A^(k)  of  eq(2.2.1),  the  covariance  matrix  [Ef]u  of  the  forward  AR  white  noise 

o  8 

driving  vector  defined  in  eqs(2.2.3),  and  the  known  correlation  matrix  [R^]  of 
the  vector  g(n).  The  latter  is  defined  as 


[Rgg]« 


,.,-Mg^n.n-Mg^' 


(2.3.1) 


where 

SjvM  n  *  t^(n'Mg)  g^(n-Mg+l)...g^(n)]  g  =  s,c.  (2.3.2) 


We  first  introduce  the  reversed  order  correlation  matrix  [Rtt]Mg+i  defined 
as 

*  El*n,n-M>.n-Mg>H)  8  = «  ^ 

where 

gT  w  *  [gT(n)gT(n-l)...gT(n-Mg)]  g  =  s,c  (2.3.4) 

n,n-M0  ** 
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and  ~  denotes  time  order  reversal.  We  note  that  the  matrix  [Rgg]  is  the 

correlation  matrix  of  1  w  =  g.  w  in  contrast  to  [Ro®]  which  is  the 

an~Mg,n  ttn,n-Mg  1 

correlation  matrix  of  the  vector  g„.M  ^  defined  in  eq(2.3.1). 


H 


The  relationship  between  Ag(k),  [Xf]u  and  [Rgg]  is  expressed  by  the 


augmented  Yule -Walker  equations  [68,69]; 
correlation  matrix 

ieM  dropping  the  subscript  on  the 

A"  [Egg]  =  ( [Iflug  [0]...[0]) 

g  =  s,c 

(2.3.5) 

where 

A”  =  [I  A«(l)  A^(2)...A»(Mg)l 

g  =  S,C 

(2.3.6a) 

[£f]ug  =  E[iig(n)Ug(n)]  =  [If]Ug 

09 

il 

C/J 

O 

(2.3.6b) 

Ug(n)  =  (uf(n)  u|(n)  ...uf(n)] 

g  =  S,c. 

(2.3.6c) 

The  corresponding  equation  for  the  wide-sense  stationary,  backward  AR 
process  is  expressed  as 

g(n)  =  - Bg(k)g(n+k)  +  ugb(n) 

g  =  s,c 

(2.3.7) 

where  we  specifically  denote  the  backward  white  noise  driving  vector  Hgb(n)  with 
the  subscript  b.  The  covariance  matrix  of  ugb(n)  is  expressed  as 

[Iblu  =  E[ugb(n)  Ugb(n  - 1)  (2.3.8) 

o 

The  corresponding  equation  for  the  backward  Yule-Walker  equations  are 
expressed  as 
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' 


'&&'•&  V  -f  .  Tj-  i,ifv'(J 

,  -■  -H.i 


E?  [figg]  -  U0]...[0]  [lb]",) 


where 


Bg*  =  [B^(Mg)...Bg  (1)  I]. 


(2.3.9) 


(2.3.10) 


2.4  MULTICHANNEL  LINEAR  FILTERING  AND  INNOVATIONS 
PROCESSES 

2.4.1.  Forward  Prediction  Error  Filter 

The  Jxl  error  vector  output  of  a  multichannel  linear  prediction  error  filter 
of  order  p  is  expressed  as 

£p(n)  =  *(n)  -  &p(nln-l,...,n-p)  (2.4.1a) 

=  2L(n)  +  £  Ap  (k)  2L(n-k)  (2.4.1b) 

k=l 

=  i  A” (k)  i(n-k)  (2.4.1c) 

k=0 

where 

&p(nln-l,...,n-p)  =  -  £  Ap(k)  *(n-k),  (2.4. Id) 

v  k=l  K 

H  H 

Ap(k)  k=l,2,...,p  are  the  JxJ  matrix  coefficients  of  the  linear  predictor,  Ap  (0)=I 

where  I  is  the  JxJ  identity  matrix  and  the  subscript  p  distinguishes  the  matrix 
coefficients  as  belonging  to  a  filter  of  order  p.  We  again  note  that  the  Hermitian 
notation  is  used  on  the  matrix  coefficients  for  notational  convenience  and  that 
these  coefficients  are  not  necessarily  Hermitian.  The  filter  structure  for  this 

implementation  is  shown  in  Fig.  2.4.1.  For  the  single  channel  case,  when  the 
scalar  £p(n)  is  minimized  in  a  minimum  mean-squared  error  (MMSE)  sense,  the 

resulting  process  is  called  a  discrete-time  innovations  process  [1,24,53,54,57].  In 
[59],  £p(n)  is  refered  to  as  a  multichannel  innovations  process.  We  note, 
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Figure  2.4.1  Multichannel  Forward  Prediction  Error  Filter. 
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however,  that  although  £p(n)  is  'whitened'  in  time,  it  is  not  necessarily  'white' 

across  channels.  We  discuss  this  further  in  chapter  6.  In  matrix  form,  we  can 
rewrite  eq(2.4.1c)  as 

£p(tl)  x  Ap  &n,n-p  (2.4.2) 

where 

Ap  =  [  I  Ap  (1)  Ap  (2) ...  Ap  (p)]  (2.4.3a) 

and 

£n,n-p  -  tiT(n)  iT(n-l)  aT(n-2) ...  *T(n-p)]  .  (2.4.3b) 


Following  a  presentation  similar  to  that  found  in  [17],  we  post-multiply  both  sides 
of  eq(2.4.2)  by  &n,n-p  ^  take  the  expectation  operation  so  that 


E[fip(n)  in,n-p]  =  E[  Ap  &n,n-p  &n,n-p] 

(2.4.4a) 

x  ApE[£n,n-p  in,n-p] 

(2.4.4b). 

=  Ap  P^xxlp-f-l 

(2.4.4c) 

where  the  subscript  p+l  denotes  the  dimension  of  the  correlation  matrix  in  terms 

of  the  JxJ  blocks  (see  eq(2.5.6)],  [E^lp+i  is  defined  as 

=  ^^in.n-p  &n,n-pl 

(2.4.5) 

and 

f^uJp+l  =  ^tin-p,n  in-p,n]' 

(2.4.6) 

Again,  ~  denotes  time  order  reversal  of  the  vector  ftn.pn. 
now  expand  the  LHS  of  eq(2.4.4a)  as 

Using  eq(2.4.3b),  we 

E[£p(n)  jJJ,n.p]  =  E{fip(n)  (*H(n)  iH(n-l) ...  *H(n-p)]} 

(2.4.7a) 
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=  {  E[£p(n)xH(n)]  E[Sp(n)i»(n-l)] ...  E[fip(n)sH(n-p)] }  (2.4.7b) 

and  determine  the  coefficients  of  Ap  subject  to  the  condition  that  £p(n)  is  a 
minimum  mean-squared  error  process.  Under  this  condition,  the  orthogonality 


principle  holds  (see  Appendix  A);  ie., 

E[£p(n)iH(n-k)]  =  [0]  1 S  k  S  p  (2.4.8) 

so  that  eq(2.4.7b)  becomes 

E(£p(n)  =  {  E[Sj,(n)iH(n)]  [0]  [0] ...  [0]  }  (2.4.9) 

where  [0]  is  a  JxJ  null  matrix.  Solving  eq(2.4.1b)  for  &(n),  we  obtain 

&(n)  =  £p(n)  -  £  A«(k)  i(n-k)  (2.4.10a) 

F  k=l 

so  that 

E[£p(n)iH(n)]  =  E[gp(n)£p(n)]  -  J^E[£p(n)iH(n-k)]Ap(k).  (2.4.1 0b) 

Again,  using  eq(2.4.8),  the  summation  term  in  eq(2.4.10b)  is  a  null  matrix. 
Substituting  the  remaining  term  into  eq(2.4.9)  yields 

E[£p(n)  jJ|,n.p]  =  {  E[gp(n)£p(n)]  [0]  (0] ...  [0)  }  (2.4.1  la) 

=  { [Sflp  (0]  [0] ...  (0) }  (2.4.11b) 

where 

[Eflp  -  E[&p(n)£p(n)]  =  [3^]”  (2.4.12) 


is  the  JxJ  Hermitian  forward  prediction  error  covariance  matrix  for  the  pth  order 
filter.  Since  eqs(2.4.4c)  and  (2.4.11b),  are  identical  expressions,  equality  of  the 
RHS  of  these  equations  provides 
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(2.4.13) 


Ap  [Rm1p+,  =  {  [%]p  [0]  [0] ...  [0] } . 

Taking  the  Hermitian  transpose  of  eq(2.4.13)  and  noting  that  is  Hermitian, 
we  obtain 

[SjpM  Ap-[Sf]pl  (2.4.14) 

where 

1T={I[0](0)...(0)}.  (2.4.15) 

Eqs(2.4.13)  and  (2.4.14)  are  the  augmented  normal  equations  for  a  forward 
multichannel  prediction  error  filter.  Thus,  Ap  contains  the  minimum  mean- 

squared  error  (MMSE)  matrix  coefficients  for  a  linear  prediciion  error  filter  of 

order  p.  We  also  note  that  eqs  (2.4.13)  and  (2.3.1)  are  identical  in  form.  This 

implies  that  the  MMSE  estimate  of  the  AR  observation  process  is  obtained 

provided  p  is  equal  to  the  order  of  the  observation  process  and  the  prediction 

error  filter  coefficients  are  identically  equal  to  the  AR  process  coefficients. 

Figure  2.4.2  shows  in  block  form  what  we  define  as  process  generation 

(synthesis)  and  the  filtering  (analysis)  procedure.  Finally,  we  note  that  the  use  of 

the  Hermitian  notation  on  the  matrix  coefficients  of  eq(2.4.1b)  resulted  in  a 

consistent  notation  in  eqs(2.4.13)  and  (2.4.14);  ie.,  the  row  vector  of  matrices 
H 

expressed  by  Ap  contains  matrices  subjected  to  the  Hermitian  operator  while  the 
column  vector  Ap  does  not.  This  consistent  notation  was  found  not  to  be  used  in 
some  of  the  literature. 

With  2f(n)  and  u(n)  initially  considered  as  non-randomt  processes,  further 
insight  can  be  obtained  by  considering  the  z-transform  of 

M  H 

*(n)  ■  *  X  A  M00&(n*k)  +  u(n)  (2.4.16) 

k-l 


+  Wc  initially  consider  non-random  processes  since  the  z-transform  of  a  random  process  is  not 
defined. 
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(2.4.17) 


so  that 

M  h  v 

X(z)  =  -I  A{J(k)X(z)z’k  +  Ii(z). 
k-1 

Bringing  the  summation  to  the  LHS,  we  can  write 


Tf  , 

I  A5(k)z"k  X(z)  -  U(z) 
k*0 


(2.4.18) 


where  Aj}(0)  =  I.  We  now  define  a  filter  representation  for  the  model  process  as 


■  M  -i-l 

H„(z)  =  £  A^(k)z‘k 
k=0 


(2.4.19) 


so  that 


X(z)  =  Hm(z)  li(z). 


(2.4.20) 


Eq  (2.4.20)  indicates  that  2£(z)  is  the  output  of  the  filter  HM(z)  with  input  U(z). 
Similarly,  the  z-transform  of  eq  (2.4.1c)  where  &(n)  and  £p(n)  are  initially 

considered  non-random  is  expressed  as 


£(z)-fi  Ap(k)z-k]x(z) 


=  Hf(z)  X(z) 


(2.4.21a) 


(2.4.21b) 


where  the  filter  transfer  function  is  expressed  as 


Hf(z)  =  iAp(k)rk 


(2.4.22) 


Ap  (0)  *  I. 


(2.4.23) 
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When  p£M,  consider  the  case 


aE(10  k£M 
.  [0]  k>M. 


(2.4.24) 


We  then  have 

Hf(z)  -  H„'(z). 


(2.4.25) 


At  this  point,  we  can  now  consider  the  input  and  outputs  of  these  filters  to 
be  random.  Using  eqs  (2.4.20)  and  (2.4.25)  in  eq(2.4.21b) 

E(z)  =  Hm(z)  Hm(z)  U(z)  =  U(z)  (2.4.26) 

In  the  time  domain,  eq  (2.4.26)  is  equivalent  to 

fip(n)  *  u(n).  (2.4.27) 

And  so,  under  the  condition  that  p=M  and  the  prediction  error  coefficients 
are  identical  to  the  coefficients  of  the  AR  model  process  and  under  the 
assumption  that  the  AR  process  is  the  exact  model  of  the  observed  process,  the 
prediction  error  filter  output  fip(n)  is  a  white  noise  vector  equivalent  to  the  AR 

model  white  noise  driving  vector.  However,  it  must  be  emphasized  that  the  use 
of  an  AR  process  with  a  white  noise  driving  function  is  usually  an  approximate 
representation;  i.e.  it  is  not  used  to  describe  the  underlying  physical  mechanisms 
which  give  rise  to  the  random  processes.  Rather,  it  is  a  representation  which  has 
a  system  transfer  function  given  by  eq(2.4.19).  We  therefore  make  a  distinction 

between  the  model  of  the  processes  (synthesis)  and  the  estimation  process 
(analysis)  [12].  In  general,  the  output  £p(n)  of  the  linear  predictor  of  finite  order 

p  is  not  a  white  noise  vector  output  due  to  the  approximate  representation  of 
physical  processes  by  an  AR  model.  In  this  dissertation,  the  observation 
processes  often  consist  of  an  AR  model  in  additive  noise.  In  general,  these  are 
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autoregressive  moving-average  (ARMA)  processes.  The  error  vector  is  also  non¬ 
white  due  to  the  fact  that  we  often  do  not  have  'a  priori'  knowledge  regarding  the 
exact  values  of  the  coefficients  for  the  model  of  the  processes.  As  a  result,  we 
must  estimate  these  coefficients  from  the  observation  data  as  we  obtain  it.  With  a 
limited  amount  of  data,  the  filter  coefficients  are  only  estimates  of  the  process 
coefficients. 

For  stationary  processes,  these  coefficients  could  be  determined  through 
estimates  of  the  multichannel  correlation  matrix  lag  values  and  the  Levinson- 
Wiggins-Robinson  algorithm  [6].  Other  methods,  however,  have  been  proposed 
by  Strand-Nuttall  and  Morf-Vieira  [7,8,9,10]  with  improved  performance  using 
limited  data.  For  non-stationary  processes,  adaptive  schemes  are  considered.  We 
will  address  this  topic  in  future  investigations.  However,  in  section  6.3  we 
propose  an  estimator  and  develop  a  likelihood  ratio  which  is  applicable  to  the  case 
where  the  associated  bandpass  processes  could  be  non-stationary. 

At  this  point,  we  note  that  eq(2.4.27)  resulted  from  the  analysis  procedure 
[via  a  linear  prediction  error  filter  with  coefficients  given  by  eq(2.4.24)]  of  the 

processes  synthesized  by  eq(2.4.16).  If  the  components  of  u(n)  are  assumed  to  be 
uncorrelated  across  channels,  the  resulting  components  of  £p(n)  are  also 

uncorrelated  in  time  and  space  (i.e.,  channels).  In  general,  however,  the 

components  of  u.(n)  may  possess  arbitrary  correlation  between  the  J  channel 
elements.  Therefore,  the  components  of  £p(n)  will  retain  a  residual  correlation 

over  the  channels  due  to  the  spatial  correlation  of  the  components  of  u(n). 

Since  the  matrix  Re£(0)  =  [If]p  =  E  [£p(n)£p(n)]  is  Hermitiant,  and  positive 

semi-definite,  we  can  perform  an  LDLH  decomposition,*  where  L  is  a  unit 
diagonal  lower  triangular  matrix  and  D  is  a  diagonal  matrix,  such  that 

Ree(0) =  [£f]p  =  LyDYLY .  (2.4.28) 

Solving  for  Dy 


Ml  is  noted  that  in  general  the  correlation  matrix  Ree  (0  is  not  Hermitian  for  1*0. 

*  Other  decompositions  such  as  Clwlesky  (see  Chapter  6.0)  or  unitaryfl]  can  be  considered.The  motivation  for  the 
LDL^  decomposition  is  noted  in  [5]. 
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(2.4.29a) 


DY=Ly1[Ef]p  [L^]h 

=  L y  E(£p(n)£^ (n)]  [1^']"  (2.4.29b) 

=  E[Ly  £p(n)^(n)  [Ly']h]  (2.4.29c) 

=  E(^(n)^(n))  (2.4.29d) 

where 

2p(n)  =  Ly  £p(n).  (2.4.30) 

Because  Dy  is  a  diagonal  matrix,  the  vector  yj,(n)  contains  uncorrelated  elements. 
Also, 


E[%(n)4?(n’)]  =  [0]  n  *  n'.  (2.4.31) 

Then,  using  eq  (2.4.30)  to  solve  for  £p(n)  and  substituting  this  result  in  (2.4.31), 
we  obtain 

E  [Ly  2p(n)2p  (n')  l"]  =  [0]  n*  n'  (2.4.32) 

so  that 

Ly  E  [^(n)jp  (n')l  l"=  [0]  n  *  n'.  (2.4.33) 

Premultiplying  and  postmultiplying  eq(2.4.33)  by  the  inverses  of  Lyand  Ly, 
respectively,  it  follows  that 

E  ftp(n)2p  (n’)l  =  [0]  n?t  n'.  (2.4.34) 

Eq  (2.4.34)  proves  the  temporal  decorrelation  of  ^,(n)  while  eq(2.4.29d)  states 
its  spatial  decorrelation.  When 
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(2.4.35) 


Ay(k)  ksM 
[0]  k>M , 

the  output  of  the  first  filter  stage  £p(n)  converges  toward  u(n)  as  noted  above,  so 

H  H 

that  [If]p«[£f]u.  Referring  to  eqs(2.2.8a)  and  (2.4.28),  LZDZLZ  «  LyDyLy. 

From  the  uniqueness  of  the  LDLH  decomposition,  it  follows  that  Lz  «  Ly.  Using 
eq(2.2.7)  in  (2.4.30), 

¥p(n)  =  Ly£p(n)  *  LzV(n)  (2.4.36a) 

=  LZLZ  z(n)  (2.4.36b) 

=  i(n).  (2.4.36c) 

Thus,  as  the  filter  coefficients  converge  to  the  coefficients  of  the  AR 
process,  ^,(n)  approximates  the  spatially  and  temporally  whitened  vector  z(n).  In 

addition,  £p(n)  has  been  obtained  through  a  causal  and  causally  invertible 

transformation  of  the  original  observation  process  x(n)  [59];  ie.  the  input  vector 
2i.(n)  could  be  recovered  through  an  inverse  filter  operation  on  £p(n). 

Furthermore,  since  Ly  is  a  unit  diagonal,  lower  triangular  matrix,  it  enables  us 

to  obtain  a  ’spatially  causal'  and  invertible  transformation  of  £p(n)  to  ^,(n). 

2.4.2.  Backward  Prediction  Error  Filter 

Let  the  backward  linear  prediction  estimate  of  the  Jxl  observation  vector 
i(n-p)  using  the  previous  p  data  samples  be  defined  as 

&0(n-pln-p+l . n)  =  -  £  Bp (k)x(n-p+k)  (2.4.37) 

F  k=l 

so  that  the  Jxl  backward  linear  prediction  error  vector  from  a  filter  of  order  p 
becomes 
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Jip(n)  =  i(n-p)  -  ip(n-pln-p+l,...,n) 

n 

(2.4.38a) 

=  i(n-p)  +  £  B?  (k)^(n-p+k) 
k=l 

(2.4.38b) 

=  £  Bp(k)i(n-p+k) 
k=0 

(2.4.38c) 

H 

where  Bp(k)  k=l,2,...,p  are  the  JxJ  matrix  coefficients 

of  backward  linear 

prediction  and  Bp(0)  =  I  where  I  is  the  JxJ  identity  matrix.  The  filter  structure 

for  this  implementation  is  shown  in  Fig  2.4.3. 

Using  the  matrix  form  and  following  a  similar  discussion  as  in  the  previous 
section,  we  can  write 

Bp(n)  =  Ep  (k)inn.p 

where 

(2.4.39) 

Bp  =  [Bp(p)  Bp(p-l) ...  Bp(l)  I], 

(2.4.40) 

It  follows  that 

E[^p(n)  ^n,n-p]  =  E[  Bp  ^ntI1.p  &n,n-p) 

(2.4.41a) 

=  Bp^E[^n,n-p  &n,n-pl 

(2.4.41b) 

=  Bp  [R^Jp+i  * 

Likewise,  we  can  obtain 

(2.4.41c) 

E[&p(n)&£n.p]  =  E{£p(n)  (*H(n)  *H(n-l) ...  *H(n-p)]} 

(2.4.42a) 

=  {  E[^p(n)iH(n)]  E[jip(n)*H(n-l)]  ...  E[&p(n)*H(n-p)]  }  .  (2.4.42b) 
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Fig  2.4.3  Multichannel  Backward  Prediction  Error  Filter 
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Since  we  are  estimating  i(n-p)  using  the  data  from  &(n)  to  j.(n«p+l),  the 
orthogonality  principle  becomes 

E[fip(n)iH(n-k)]  =  [0]  OSkS(p-l)  (2.4.43) 

so  that  eq(2.4.42b)  becomes 

E[fip(n)  &,„-p]  =  {  (0) ...  (0)  E[Bp(n)iH(n-p)]  } .  (2.4.44) 

Taking  the  Hermitian  transpose  of  both  sides  of  eq(2.4.38b)  and  solving  for 
iH(n-p) 

lH(n-p)  =  Bp  (n)  -  £  iH(n-p+k)B.(k).  (2.4.45) 

k=l  F 

Premultiplying  both  sides  of  eq(2.4.45)  by  jip(n)  and  taking  the  expectation,  we 
have 

E[£p(n)xH(n-p)]  =  E[fip(n)j^(n)]  -  £e[Bp  (n)xH(n-p+k)]Bp(k).  (2.4.46) 

k*l 

Note  that  the  summation  term  in  eq(2.4.46)  is  a  null  matrix  from  the 
orthogonality  condition  of  eq(2.4.43).  Substituting  the  remaining  term  into 
eq(2.4.44),  yields 

E[fip(n)  iL-pl  =  {  [0] ...  (0]  (rb]p  }  (2.4.47) 

where 

[Ib]p  «  E[Bp(n)£^(n)]  =  [Ib]p  (2.4.48) 

is  the  Hermitian,  JxJ  multichannel  backward  prediction  error  variance  matrix  for 
the  p  th  order  filter.  Combining  eq(2.4.40c)  and  (2.4.47),  we  have 

Bp  (fyp+,  =  { [01  [0) ...  [0]  [lb]”  } .  (2.4.49) 
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Taking  the  Hermitian  transpose  of  eq(2.4.49)  and  noting  that  [fc^lp+i  is 
Hermitian,  we  obtain 

fRjxlp+i  Bp  =  [Ib]p  T  (2.4.50) 

where  T  is  the  reversed  order  vector  of  matrices  defined  in  eq(2.4.15);  ieM 

jP  =  {  [0] ...  [0]  I }.  (2.4.51) 

2.4.3  The  Multichannel  Lattice  Filter 

The  forward  and  backward  prediction  error  filters  introduced  in  the 
previous  sections  are  now  combined  into  a  single  structure.  From  eq(2.4.1c),  the 
forward  error  vector  from  a  pth  order  prediction  error  filter  (PEF)  is  expressed 
as 

£p(n)  =  i  Ap(k)  i(n-k).  (2.4.52) 

v  k=0 

In  the  next  section,  we  will  define  an  update  equation  for  the  pth  order 
multichannel  forward  and  backward  PEF  coefficients  Ap(k)  and  Bp(p)  using 

eqs(2.5.2)  and  (2.5.4)  which  are  expressed  as 

Ap(k)  =  Ap.j(k)  +  Bp.1(p-k)[rf]p  k=l,2 p-1.  (2.4.53a) 

and 

Bp(k)  =  Bp.j(k)  +  Ap.1(p-k)[rb]p  k=l,2 p-1  (2.4.53b) 

Substituting  eq(2.4.53a)  into  (2.4.52),  we  have 

£  (n)=  £  A”  ,(k)  i(n-k)  +  (rf)"  £  B"  ,(P-k)  S(n-k). 

F  k=0  k=0 


(2.4.54) 


Noting  that  Ap.j(P)  =  Bp.i(P)  =  [0]  at  k=P  and  interchanging  the  notation  on  the 
second  summation  in  eq(2.4.54),  we  have 

£p(n)  =  X  A^.,(k)  j(n-k)  +  [rf]£  X  B“,(k)  i(n-P+k).  (2.4.55) 


Similarly,  the  corresponding  backward  PEF  output  for  the  pth  order  filter 
defined  in  eq(2.4.38c)  is  expressed  as 


flp(n)  =  X  Bp(k)i(n-p+k). 
k*0 

For  a  backward  PEF  of  order  p-1  at  time  n-1,  we  have 


fip-i(n-l)  =  £  i(k)i(n-p+k) 


(2.4.56) 


(2.4.57) 


while  for  a  forward  PEF  of  order  p-1  at  time  n,  eq(2.4.52)  yields 


v'Xa" 


£p-i(n)  =  £  Ap-i(k)  i(n-k). 
k=0 


(2.4.58) 


These  last  two  equations  can  be  substituted  into  eq(2.4.55)  so  that 


£p(n)  *  fip-^n)  +  (Tfljap-^n-l) 
*  £p-i(n)  +  Ap(P)  ap.,(n-l). 


(2.4.59a) 

(2.4.59b) 


Similarly,  we  can  substitute  eq(2.4.53b)  into  (2.4.56)  to  obtain 
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fip(n)  =  t  B"  ,0c)  s(n-P+k)  +  (rb)"  K^IP-k)  s(n-P+k)  (2.4.60a) 
k=0  k«0 

=  t  B  p.,(k)  i(n-P+k)  +  trb)”  t  Ap.|(P-k)  l(n-k)  (2.4.60b) 


where  we  again  used  the  fact  that  Ap.jCP^Bp.^)*  [0]  at  k=P  and  an  interchange 

of  notation  on  the  second  summation  in  eq(2.4.54).  Using  eqs(2.4.57)  and 
(2.4.52),  we  obtain 


fip(n)  =  fip.,(n-l)  +  (r5]p  £p.,(n)  (2.4.61a) 

=  fip.,(n-l)  +  Bp(P)  £p.j(n).  (2.4.61b) 

Eqs(2.4.59)  and  (2.4.61)  are  the  order  update  recursions  for  stage  p 
multichannel  lattice  predictor.  The  initial  conditions  are 

£o(n>  *  Wn)  =  &(n)-  (2.4.62) 

The  structure  of  the  filter  which  satisfies  eqs(2.4.59)  and  (2.4.61)  is  shown 
in  Fig.  2.4.4. 
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2.5  PARAMETER  ESTIMATION  ALGORITHMS 


In  this  section,  we  derive  the  Levinson-Wiggins-Robinson  [6]  and  the 
Strand-Nuttall  [8,10]  algorithms  which  are  used  to  estimate  the  coefficients  of  the 
autoregressive  processes. 


2.5.1.  Levinson-Wiggins-Robinson  Recursion 

We  now  develop  a  recursive  procedure  to  determine  the  multichannel 
forward  and  backward  matrix  coefficients.  The  procedure  was  initially  presented 
by  Wiggins  and  Robinson  [6]  based  on  the  scalar  version  of  Levinson  [163].  The 
approach  presented  in  this  subsection,  however,  is  similar  to  that  used  by  Strand 
[8].  Consider  the  pth  order  update  of  the  multichannel  forward  PEF  coefficient 
expressed  in  the  form 


Ap- 


Ap(0) 

Ap(l) 

Ap(2) 


Ap(p-l) 

.  Ap(p)  . 


'  Ap.,(0)  * 

Ap-.d) 

Ap.,(2) 

• 

Ap.^p-0 
■  [0]  - 


[0] 

Bp-i(p-l) 

Bp.^2) 

Bp-,(D 
.  Bp-i(0)  J 


TO 


(2.5.1) 


where  [Tf]p  is  a  constant  matrix  called  the  forward  reflection  coefficient  matrix 
and  Ap(0)=Ap.1(0)=Bp.1(0)  =  I,  the  JxJ  identity  matrix.  The  update  equation  is 
therefore  expressed  as 


=  Ap.1(k)  +  Bp.1(p-k)[rf]p 

k=l,2,...,p-l 

(2.5.2a) 

-  [rflp 

k=p 

(2.5.2b) 

-[0] 

lop 

(2.5.2c) 

=  Ap(0)  =  I 

k=0. 

(2.5.2d) 

Consider  the  order  update  of  the  backward  PEF  coefficient  as 
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'  Bp(p)  1  f  [0]  1  r  Ap.,(0)  - 

Bp(p-D  Bp.,(p-1)  Ap.,(l) 

Bp=  =  +  irb]p  (2.5.3) 

Bp(l)  Bp.,(l)  Ap.,(p-1) 

_  Bp(0)  J  Bp.|(0)  J  L  [0]  - 

where  [rb]p  is  the  backward  reflection  coefficient  matrix.  The  update  equation  is 
expressed  as 


«  Bp.j(k)  +  Ap.^p-kXrb) 

k=l,2,...,p-l 

(2.5.4a) 

-  irb]P 

k=P 

(2.5.4b) 

-[0] 

lop 

(2.5.4c) 

n 
✓ — 
o 

^Q. 

CQ 

II 

k=0. 

(2.5 .4d) 

We  now  determine  the  conditions  under  which  the  above  equations  hold. 
First,  we  take  the  Hermitian  transpose  of  eq(2.5.1)  and  postmultiply  both  sides  of 

the  equation  by  [R^]p+i-  For  the  LHS,  eq(2.4.13)  provides 

A?  [RxsV,  =  { (Sflp  (0) ...  (0]  }  (2.5.5a) 

where  [If]p  is  the  JxJ  forward  error  covariance  matrix  for  a  pth  order  filter. 

Each  side  of  eq(2.5.5a)  is  a  vector  of  matrices  containing  p+1  matrix  elements. 
Taking  the  Hermitian  transpose  of  Ap  in  eq(2.5.1)  and  using  it  in  (2.5.5a),  we 

also  have 

Ap  [Rjulp+i  =  {  Ap.,  (0) }  (Rjalp.,  +  (rf]p  {  [0]  Bp-, }  [Ra]p.,  (2.5.5b) 

so  that 

{ [Iflp  [0] ...  (0)  }  =  {  [0] }  IR^lp.,  +  [rf)p  {  [0]  Bp., }  (Rjilp+i  •  (2-5.50 
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Let  us  now  introduce  a  partitioned  fomt  of  [fijj]p,i  such  that 


(RxxIihi  * 


R»(0)  R„(l)  R„(2)  ...  R„(P) 

R»(-D  Rxx(0)  R«0)  -R„(P-1) 

•  »  •  •  • 

•  •  9  9  9 

R„(l-p)R„(2-p)R„(3-p)...  RX1(1) 
R„(-p)R„(l-p)R„(2-p)...  R„(0) 


^Sxx^p 

H  (2.5.6) 

(Sxx)p[Rxx(0)] 


where  (£xx)p  ls  a  vector  containing  p  matrix  elements  and  is  defined  as 


(&xx)?-[Rxx(-P).R*xO-P).-^w(-1)]* 


(2.5.7) 


We  now  consider 

{A^t  (0)  }  [R^V,  =  {A^.,  [0]  }  f"  [Rmlp  (5xx)p  1  (2.5.8a) 

_(S»>p[Rxx(0)]_ 

=  (A^iIRjilp  Ap-i(SXx)p  )  •  (2.5.8b) 

However,  we  can  reduce  the  order  of  eq(2.5.5a)  by  one  and  obtain  the  Hermitian 
transposed  vector  which  will  now  contain  p  matrix  elements,  so  that 

a£,[Km]p  =  ([If]".,  [0] ...  [0]).  (2.5.9) 

Let  us  now  define 

[A)p  =  A^.,(5xx)p  =  (I  Ap.i(l)  a“,(2)  ...  Ap.,(p-1))  f  RJP>  1  (2.5.10a) 

R„,(p-i) 

-  Rxxd)  - 
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(2.5.10b) 


=  R„(P)  +  1)  Ap.,(k)R„(p-k). 

k=l 

Substituting  eqs(2.5.9)  and  (2.5.10a)  in  (2.5.8b),  we  have 

(Apt  (01)  [RjaV,  =  {[Sf]“i  [0]  -  (01  [Alp  )• 

We  will  utilize  this  expression  later.  We  now  repartitioned  [R2 
the  form  given  by 


[RxiV+i = 


R*x(0)  R„(l)  R»(2)  ...  R„(p)  ' 

R„<-1)  R„(0)  R„(l)  ...R„(P-D 

•  •  •  •  • 

•  •  •  •  • 

R„(l-p)R„(2-p)R„(3-p)...  R,s(l) 

L  R„(-P)  R„(l-p)R„(2-p)...  R^,(0)  J 


H 


Rxx(0)  (B*x)p 

L  (&xx)p  P^lp 


where 


(Rxx)p  ~  [R»(D  Rxx(2)  •••  Rxx(p)]- 


We  now  consider 


{[01  fi£i}(RJP+,  =  ([0]  Bp- 1 } 


H 


Rxx(0)  (&xx)p 


L(Kxx)p  tRJp 
-  {fip-i(Rxx)p  sp-in^2ix^p  ^  * 
However,  reducing  eq(2.4.49)  by  one  order,  we  have 


B^iCR^lp*  {[°1 «.  [0]  [Zblp-i) 


H 


Let  us  now  define 


(2.5.11) 
*lp+i int0 

(2.5.12) 

(2.5.13) 

(2.5.14a) 

(2.5.14b) 

(2.5.15) 
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(2.5.16a) 


{Alp  a  fi£,  (Exx)p 

=  (B“,(p-1)  b“,(P-2)  ...  Bp.i(l)  1}  ffU'Ol  (2.5.16b) 

R»(*2) 

Lr„(-p)- 

=  R„(-P)  +  ^  Bp.,(k)R„(k-p).  (2.5.16c) 

k=l 

Substituting  eqs(2.5.15)  and  (2.5.16a)  into  (2.5.14b),  yields 

{(0)  b£i}[Rm]p+1  =  {[A'lp  [0] ...  (0)  (Xb]p.,).  (2.5.17) 

Using  eqs(2.5.11)  and  (2.5.17)  in  (2.5.5c),  we  obtain 

{(Eflp  [01 ...  [0|)  =  {[If]",  [0] ...  [0)  [Alp  } 

+  (rf]p  { (Alp  [0] ...  [0]  [Xb]p., } .  (2.5.18) 

And  so,  in  order  for  eq(2.5.1)  to  hold,  we  must  satisfy  eq(2.5.18).  From 
eq(2.5.18),  we  have 

(Eflp  =  [Iflp-i  +  [rf]p  [A'lp  (2.5.19) 

and 

[0]  *  [Alp  +  [rf]p  (Iplp.,.  (2.5.20) 

From  eqs(2.5.20)  and  (2.5.2b),  we  have 

(rf]p  =  Ap  (p)  =  -  (A)”  {(Xbl^,)'1.  (2.5.21) 


We  must  now  return  to  eq(2.5.3)  and  carry  out  a  similar  procedure  that 

H  ^ 

was  carried  out  for  eq(2.5.1);  ie.,  we  post-multiply  Ep  by  so  that 
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(2.5.22) 


fipH  tVVi  =  ( t°)  t°]  [Zb]p). 

For  the  first  term  on  the  RHS  of  eq(2.5.3),  we  postmultiply  by  the 
partitioned  form  of  eq(2.5.12).  In  this  case,  we  obtain  the  same  results  as 
expressed  in  eqs(2.5.14a)  through  (2.5.17).  For  the  second  term  on  the  RHS,  we 
postmultiply  by  the  partitioned  form  of  eq(2.5.6)  so  that  we  obtain  the  same 
results  as  expressed  in  eqs(2.5.8)  through  (2.5.11).  Substituting  these  results  into 
eq(2.5.22),  we  have 


{ [0] ...  (0)  [£b]p  }  =  { [A'lp  [0] ...  [0]  [Iblp., } 

+  trb]p  { [Zflp.,  [0] ...  [0]  [Alp  } .  (2.5.23) 

Eq(2.5.23)  must  therefore  be  maintained  in  order  for  the  recursion  in  eq(2.5.3) 
to  hold.  From  the  above  equation,  we  have 

[Ib]p  =  [Iblp.,  +  [rb]p  [A]"  (2.5.24) 

[01  =  [A'lp  +  [rb]p  [If]",.  (2.5.25) 

From  eqs(2.5.25)  and  (2.5.4b),  we  have 

trb]p  =  Bp(p)  =  -  [A']"  {  [Zf]p., }-'.  (2.5.26) 


Before  summarizing  the  pertinent  recursion  equations  used  to  estimate  the 
forward  and  backward  coefficient  matrices,  we  can  at  this  point  develop  several 
important  relationships.  Using  equations  (2.5.21)  and  (2.5.25)  in  (2.5.19),  we 
obtain 

[Eflp  =  [Sflp-i  +  [rf]p  [A']p  (2.5.27a) 

=  [Zflp.,  -  Ap  (p)  [rb]p  [Zflp.,.  (2.5.27b) 

Using  eq(2.5.26)  in  (2.5.27b),  we  have 
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(2.5.28a) 


[£f]p  =  [If]",  ■  A" (p)  B" (p)  [If]", 


so  that 


[If]p  >=  {I- Ap(P)  Bp(p)}  [If]",. 
Similarly, 

[Ib)p  =  {I  -  Bp(p)Ap(p)J  [Iblp.,. 


Let  us  also  consider  the  matrix  identity  [17]“ 


H 


(Ap-i  [0]}  [R^lp+i 


'[Of 

Lfip-i. 

H 


{[0]  B.p-,1  [RjJp+i 


Ap-i 

L  [0]  JJ 


tH 


,H 


which  follows  since  [R^lp+i-  [R^lp+i-  Using  eqs(2.5.11)  and 
(2.5.30),  we  can  write 


([If]",  (0]  ...  [0]  [A|"lr  (0| 

Bp-idP-D 

Bp-lO) 

L  I  J 

HA']”  [0] 


[01  [Zblp-il 


-tH 


Vl(1) 
Vi(2) 

V^p-1) 

L  [0]  JJ 


*  We  note  the  typographical  error  in  eq(15.77)  in  ref  (17]. 


(2.5.28b) 

(2.5.29) 

(2.5.30) 
(2.5.17)  in 


(2.5.31) 
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so  that  after  carrying  out  the  matrix  multiplications  in  eq(2.5.31),  we  have 

[A]p  =  [A']p.  (2.5.32) 

Eq(2.5.32)  is  useful  since  it  reduces  the  computations  involved  in  the 

determination  of  the  reflection  coefficient  matrices;  ie.,  eqs(2.5.21)  and  (2.5.26) 
can  both  be  expressed  in  terms  of  [A]pt  so  that 

(rf]p  =  Ap(p)  =  -  (A]p((Ib]p.,)''  (2.5.33a) 

(rb)p  =  Bp(p)  =  -  (A)p{[lf)”,  I'1.  (2.5.33b) 

In  the  single  channel  case,  the  scalar  forward  and  backward  prediction 
error  variances  are  equal.  Since  [A]p  is  a  scalar,  it  follows  from  eqs(2.5.33)  that 
♦ 

ap(p)=bp(p). 

We  again  note  that  the  expressions  developed  here  are  in  terms  of  the 
Hermitian  operator  as  opposed  to  those  often  shown  in  the  literature.  This  stems 
from  the  notation  used  to  express  the  autoregressive  equation  in  eq(2.2.1)  and 
provides  a  more  consistent  notation  as  stated  previously.  We  now  summarize  the 
pertinent  equations  for  the  recursion  to  update  the  forward  and  back-vard  PEF 
coefficients.  First,  we  have  the  definitions 


[A]p  S  R„(p)  +  X  Ap^R^p-k) 
k=l 

(2.5.34a) 

(Alp  s  R„(-p)  +  X  Bp.,(k)R„(k-p). 

k=i 

(2.5.34b) 

However,  as  shown  previously 

(A]p  =  [A]p. 

(2.5.35) 

Hence,  we  need  use  only  one  of  the  equations  in  eqs(2.5.34).  Next,  from 
eqs(2.5.33) 
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(2.5.36a) 


trfi“  -  a“(P)  =  -  ia]“  { [^j” . } -1 
trblp  “  Bp(p) » -  lAlpUlf]",)-1 

where 

Wp  “  {l  *  Ap(p)  Bp(p)}  [lf]p.i. 

(rb]p  -  {I  -  Bp (P)Ap (p))  [Ibip.,. 


Then, 


Ap(k) 

Bp*(k) 


Ap.,(k)+[rf]^Bp.1(p-k) 

trf)p 


k=l,  2,  ...,  p-1 


k=P 


fBp.^k)  +  [rb]p  Ap.,(p-k) 
lrblp 


k=l,  2, ...,  p-1 
k*p. 


(2.5.36b) 


(2.5.37a) 

(2.5.37b) 


(2.5.38a) 


(2.5.38b) 


We  initiate  the  procedure  using  the  initial  conditions  for  eqs(2.5.37) 
H  H 

flflo  *  l^O  *  Rxx(O)  80  that  eqs(2.5.38)  provide 


as 


A^d)  -  irf]”  -  -  [A]”  {[Zb]”}1 

"  '  Rxx^)Rxx(O) 

b”(1) - [rb]“ -.[a]j  {[if]”}-1 

“ '  Rxx(*l)Rxx(0). 


(2.5.39a) 

(2.5.39b) 

(2.5.39c) 

(2.5.39d) 


ITie  procedure  continues  recursively  and  continues  until  the  desired  order 
is  reached. 


2.5.2.  The  Strand-Nuttall  Method 

The  multichannel  harmonic  mean  algorithm  which  is  a  generalization  of 
the  Burg  method  was  proposed  independently  by  Strand  [8]  and  Nuttall  [10].  In 
the  single  channel  case.  Burg  [35]  estimated  the  reflection  coefficients  directly 
from  the  data  subject  to  the  constraint  of  minimizing  a  performance  index 
consisting  of  the  mean-square  values  of  the  estimates  of  the  forward  and 
backward  prediction  errors.  In  this  case,  the  scalar  forward  coefficients  of  linear 
prediction  are  the  complex  conjugates  of  the  backward  coefficients  [87,126,38]. 
In  the  multichannel  case,  however,  the  forward  and  backward  reflection 
coefficient  matrices  are  related  by  eqs(2.5.33a)  and  (2.5.33b),  respectively. 
These  equations  indicate  that  the  multichannel  forward  and  backward  reflection 
coefficient  matrices  have  a  more  complicated  relationship  than  in  the  scalar  case. 
Specifically,  they  are  related  through  the  forward  and  backward  error  covariance 
matrices.  Solving  eqs(2.5.33)  for  -[A]p  and  noting  that  the  error  covariance 

matrices  are  Hermitian,  we  have 

[A]p  =  Ap  (p)  [I5]p.!  =  [If]p.,  Bp(p).  (2.5.40) 

From  eq(2.5.38)  at  k=p,  we  have 

•  [A]"  =  [I-f]p  -  (I,)",  (rb]p.  (2.5.41) 

These  equations  show  the  relationship  between  the  forward  and  backward 
reflection  coefficients  and  error  covariance  matrices  as  well  as  the  matrix  [A]^. 

In  the  Strand-Nuttall  algorithm,  it  is  this  latter  matrix  that  we  solve  for.  In 
eq(2.5.41),  note  that  the  error  covariances  can  be  obtained  from  stage  p-1.  Two 
additional  well  known  relationships  between  the  forward  and  backward  error 
residuals  can  be  expressed  as  [8,10,38] 

£p(n)  =  £p.,(n)  +  Ap  (p)  fip.,(n-l)  (2.5.42) 

and 
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(2.5.43) 


fip(n)  =  fip.^n-l)  +  Bp(p)  £p.j(n). 

In  this  section,  we  will  establish  a  performance  function  which  depends 
upon  estimates  of  the  forward  and  backward  error  covariance  matrices.  This 
performance  function  will  be  minimized  with  respect  to  the  matrix  [A]p .  In  the 

multichannel  case,  the  reflection  coefficients  are  chosen  such  that  wqs(2.5.41) 

through  (2.5.43)  are  satisfied.  These  are  the  constraint  equations  under  which  - 
[A]p  will  be  selected  to  minimize  the  performance  function.  Using  the  notation  of 

Nuttall  [10],  we  consider  the  unbiased  error  residual  matrices  over  the  available 
data  for  a  filter  of  order  p  as 

1  hi  j, 

Ep  =  jq.rj  £p(k)£p  (k)  =  Ep  (2.5.44a) 

F  k=p+l 

Fpsj^r  S &p(k)fip (k)  =  f>.  (2.5.44b) 

F  k=p+l 

Using  eqs(2.5.42)  and  (2.5.43)  in  the  above  equations  and  expanding  yields 
EP  s  £  [£P-i(k)£p-iOO  +  Ap(p)fip.1(k-l)£^.1(k)  + 

F  k=p+i 

£p.  i  (k)^.  i  (k- 1 )  Ap(p)  +  Ap  (p)Jip. ,  (k- 1  )0^- !  (k- 1 )  Ap(p)  ]  (2.5.45a) 

and 

Fp  =  S  [ap.,<k-l)lip-,(k-l)  +  B? (p)£p. , (k)Hp. , (k- 1 )  + 

F  k=p+l 

fip.i(k'l)%.i(k)Bp(p)  +  Bp  (p)£p.,(k)4I.,(k)Bp(p)]  (2.5.45b) 

so  that 

Ep  =  t^fflp-i  +  Ap(p)  [ftfblp*,  +  [ft(b)p.lAp(p)  +  a“ (p)(ftbb]p.,Ap(p)  (2.5.46a) 
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Fp  =  [ftbblp-i  +  Bp(p)  [ftfl,],,.,  +  [ftfl,]“,Bp(p)  +  Bp  (p)[ftff]p.1Bp(p)  (2.5.46b) 
where  the  estimated  time-averaged  error  covariance  matrices  are  expressed  as 
A  1  N  ¥J 

tKff]p-i  •fh  1  £p.i(k)£p-i(k)  (2.5.47a) 

y  k=p+l 

.  1  N  TJ 

[^n.]p-i  =  N^  1  £p-,(k)ap-i(k-l)  (2.5.47b) 

V  k=p+l 

=  (2.5.47c) 

V  k=p+l 

A  i  N  « 

fRbblp-i  =  ih  I  (2.5.47d) 

F  k=p+l 

In  the  Strand-Nuttall  algorithm,  we  minimize  the  sum  of  the  traces  of  the 
weighted  error  matrices 

W^p)  =  trCAp.^?)  +  trCQp^Fp)  (2.5.48a) 

where  Ap.j  and  Qp.!  are  Hermitian,  positive  definite  matrices  which  weight  the 
matrices  Ep  and  Fp,  respectively.  These  matrices  provide  arbitrary  weights  and 

their  selection  will  be  determined  later.  Eq(2.5.48a)  is  the  performance  function 

mentioned  previously.  In  the  single  channel  case,  we  can  consider  minimizing  an 
index  of  performance  Ip(rp)  expressed  here  as  the  weighted  sum  of  the  mean- 

squared  values  of  the  forward  and  backward  prediction  errors  ep(n)  and  (3p(n), 
respectively;  ie., 

Ip(rp)  =  aE[l£p(n)l2]  +  (l-a)E[lpp(n)l2].  (2.5.43b) 

Burg  considered  the  minimization  of  eq(2.5.48b)  for  the  case  where  a=l/2. 
We  will  show  that  the  minimization  of  eq(2.5.48a)  as  developed  here,  leads  to  a 
generalization  of  the  results  obtained  by  the  minimization  of  eq(2.5.48b)  with 

a=l/2.  Using  eq(2.5.40),  let  us  define  Gp  such  that 
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Gp  ■  -  [A]p  =  Ap(p)  [Ip]”,  =  [Iflp., Bp(p).  (2.5.49) 

Changing  notation  for  the  Hermitian  error  covariance  matrices  to  a  form  similar 
to  Nuttalls  [10],  let 

Up.,  *  (Sflp.,  (2.5.50a) 

Vp.,  a  [Xb)p.,  (2.5.50b) 

so  that 

Ap(p)  =  Gp  [V^lH  (2.5.51a) 

Bp  (p)  =  GplUp1.,]".  (2.5.51b) 


Using  the  last  two  equations  together  with  eqs(2.5.46),  we  can  write 

Ap.,Ep  +  np.|Fp  =  Ap.,  { (ftfflp.,  +  GpV^l^ftlp”,  +  [ftfblp.itVjJ.tlGp 

+  Gp  (VjJ.|]H(ftb|,)p.1(Vjj.1)Gp  } 

Qp-i  { [£bb]p.,  +  Gp[U^.1]B[ftjb]p.,  +  [ftflJ^.IU^lGp 

+  Gp[U^]H[ftff]p.I(U^,](^1 }  ■  (2.5.52) 


Taking  the  trace  of  eq(2.5.52)  and  rearranging  terms,  we  obtain 


b'lAp.lEP  +  gp^fp]  = 

=  tr{  Ap.i^fflp-1  +  Op-Ablp-i  +  Vi°P  I r^il^fblpi 

+  £V>[ftfb]“,[U^-1]Gp  } 

+  «p{  [Ap-,tftfb]p-1[Vp,.1]  +  Ap.iGP  [^iP^bblp-i^.llGp 

+  Op.1Gp[Up‘1]HlAft]p.1  +  np.1Gp[U^1]H(ftff]p.1[U^1]Gp  } . 

(2.5.53) 

We  now  consider  the  matrix  relation 

tr[KL]  =  tr[LK]  (2.5.54) 

where  K  and  L  are  conformable  matrices.  Noting  that  all  the  above  matrices  are 

JxJ,  the  last  two  terms  in  the  second  trace  of  eq(2.5.53)  can  be  reexpressed  (ie., 
with  K=  Qp.jGp  and  L  defined  accordingly  for  each  of  these  last  two  terms).  Gp 

can  then  be  factored  out  in  the  second  trace  term  so  that 

-  «{ Vi(ftff]p-| + ^-i^bbip-i + ViG?tvp'->lH^fb]p-i 

+  Gp-1[ftfbl”IrU^,)Gp} 

+  tr{  [Ap.1[ftfb]p.,[Vp1.1]  +  Ap.,Gp 

+  [U^1]H[ftftlp.inp.i  +  [U^]H^ff]p..[U^,]Gp  )flp.,]Gp  } . 

(2.5.55) 

Nuttall  now  minimizes  eq(2.5.55)  by  choice  of  Gp  (in  the  Hermitian 

notation  used  here),  subject  to  eqs(2.5.41)  through  (2.5.43).  Eq(2.5.49)  can  then 

H  H 

be  used  to  solve  for  the  coefficients  Ap(p)  and  Bp(p)  which  achieve  this 
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minimization.  Nuttall  [10]  points  out  that  the  above  equation  is  minimized  by 
setting  the  coefficient  of  Gp  [contained  in  the  large  square  brackets  of  the  second 

trace  term  of  eq(2.5.55)]  equal  to  a  null  matrix  [85].  Premultiplying  this 

coefficient  by  [Ap.j]  and  post  multiplying  by  [Qp.i],  we  obtain 


+  GpP/p'jH  [Abb]p.1[Vp.1]  Op1., 

+  [A'Iii][U^1]H[ftfl)]p.1  +  [UjJ.,]c£  =  [0]  (2.5.56a) 

so  that  after  rearranging  terms 

-  Gp(VjJ.,]H  [ftbb)p.,(Vp.J  Op'.,  -  (Up.,]G“  = 


=  [ftfolp-^iHOp-,]  +  (A^]nJp'i)H(Afb]p.i  ■  (2.5.56b) 

However,  from  eq(2.5.49) 

Gp  s  -  [A]p  (2.5.57) 

so  that 

[ft]JUH  +  BH[A]p  =  CH  (2.5.58) 

A  H 

where  [A]p  is  recognized  as  an  estimate  since  limited  data  is  being  used  in  this 
equation  and 

=  [V'^JH  (ftbblp.ilVp1.,)  Op'.,  (2.5.59a) 

Bh  =  Apl.,[U^.1]H(ftff]p.1  [Up1.,]  (2.5.59b) 

CH  =  [ftfb]p.,[Vp.1)[np1.1)  +  [Af)_i][U^.l]H(ftflj]p.1 .  (2.5.59c) 


In  reference  [10],  Nuttall  examined  several  forms  of  the  weighting  matrices 
Ap.j  and  Qp.j  and  showed  that  stable  conditions  are  achieved  if 


47 


and 


Ap.,  =  Up1.,  a  [EfljJ.,  (2.5.60) 

Op.,  =  V^,  -  (Splp1.,  .  (2.5.61) 

Thus,  the  constant  matrices  ,  BH  and  CH  simplify  to 

AH  =  [V£,]H  (ftbb]p.,  =  (Vp'.,]H  [ftbb]",  (2.5.62a) 

BH  =  [ftfflp.,  (Up-il  =  (ftfflp.,  tU^,]H  (2.5.62b) 

CH  =  2[ftfb]p.1  (2.5.62c) 


where  (Hbb]p.,.  (RffL.,  and  [Up.,]  are  Hermitian.  We  note  that  and  BH  each 

contain  the  product  of  two  matrices.  The  matrices  [Up.i]  and  [Vp.i]  are  the 

forward  and  backward  error  variances  for  a  filter  of  order  p-1,  respectively. 
They  are  obtained  from  the  Levinson-Wiggins-Robinson  recursion.  The  matrices 
C&fflp-j  and  [^bblp-i*  however,  are  time-averaged  estimates  of  these  variances 

using  limited  data  [see  eqs(2.5.47)].  Using  eqs(2.5.62),  eq(2.5.58)  is  now  written 
as 

[Alp  (V^,]H  [ftbb£,  +  [ftffl",  [UjJ.,]H$]p  =  2[ft(b]p.,.  (2.5.63) 

In  the  single  channel  case,  each  element  is  a  scalar  where 

Up.t  -  Vp.,  n  «£,  (2.5.64) 

and  a” (p)  =  [rf]p  =  -  [&]p[V^,]H becomes 
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(2.5.65) 


From  eqs(2.5.47),  the  terms  [^bblp-i »  I^fblp-i  ^or  ^e  case  can 

be  expressed  as 


k=p+l 


$(bU=ik  S  Ep.^k^oc-i) 


k=p+l 


•  Abblp-i  =  (ftbblp-i  iPp-.(k-DI2- 


k=p+l 


(2.5.66a) 

(2.5.66b) 

(2.5.66c) 


Using  eqs(2.5.64)  through  (2.5.66),  the  scalar  version  of  eq(2.5.63)  can  be 
written  as 


‘  n  ]  r  n  ]  r  n 

•  »p(p)  S  l(Jp.1(k-l)|2  .  Xlep-i(k)|2  ap(P)  =  2  Iep.>(k>Pp!>(k-1) 
[k=p+l  J  |k=P+l  J  Lk=p+1 

(2.5.67) 

Solving  eq(2.5.67)  for  a£(p),  we  have 

N 

2  £  [ep.i(k)Pp!i(k-l)] 

aj(p)  -  fj  -  -  -N~:RhJ - •  (2.5.68) 

2[lep.,(k)l2  +  l(3p.1(k-l)|2] 

k=p+l 

The  result  expressed  in  eq(2.5.68)  is  the  estimate  of  the  single  channel 
Burg  reflection  coefficient.  This  result  is  equivalent  to  that  obtained  by 
minimizing  eq(2.5.48b)  with  respect  to  Tp  [35].  Thus  the  results  presented  here 

are  a  generalization  of  the  single  channel  Burg  algorithm. 


Before  summarizing  the  pertinent  equations  in  this  algorithm,  we  will  first 
consider  a  solution  to  eq(2.5.58)  to  determine  [A].  Taking  the  Hermitian  of  both 
sides  of  eq(2.5.58),  we  have 

A.  (i]p  +  [&]p  B  =  C.  (2.5.69) 


Nuttall  [10]  considered  a  solution  of  this  equation  in  the  form 


$]p  =  PQ-1 


where 


and 


J-l 


P  =  Y  (-\)kAkC  BJ'lk 
k=0 


(2.5.70) 


(2.5.71a) 


Q  -  X  (-l)kukBJ*k  (2.5.71b) 

k=0 

where  P  and  Q  are  JxJ  matrices,  the  scalar  constants  {ak}  k=0,l,...J  are  given  by 


ak  =  "  k  ^***^-1)  1  £  k  £  J 

=  1  k  =  0 

and  the  matrices  {*4.k}  satisfy  the  recurrence  relationship 


(2.5.72a) 

(2.5.72b) 


A k  =  AA^. i  +  »kI  1  1  k  <  J  (2.5.73a) 

=  1  k  =  0.  (2.5.73b) 

For  the  two  channel  case  (ie.,  J=2),  we  have  (see  Appendix  B) 

P  =  C  B  -  [A  -  tr {A)  I]  C  (2.5.74a) 

and 

Q  =  BB  +  trM)B  -  \  tr{  A  [A  -  trfy*)l] }  I.  (2.5.74b) 


Eq(2.5.74b)  can  be  further  simpified  by  considering  the  matrix  characteristic 
equation 
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Isl  -  SI  =  0 

so  that 

’  s  0 
[o  s 
or 

S2  "  (&n  +  ^22^  S  +  (^11^22  -  £>21^12^  =  0* 


&nfci2 

s-6n 

*12 

621  &22. 

■*21 

s**22 

(2.5.75) 


(2.5.76a) 


(2.5.76b) 


From  the  Caley -Hamilton  theorem,  we  can  substitute  s=B,  so  that 

B2  -  (trB)B  +  (detB)I  =  [0]  (2.5.77a) 

or 

B2  =  (tiB)B  -  (detB)I.  (2.5.77b) 

Using  this  relation  in  eq(2.5.74b),  we  have 

Q  =  (trB)B  -  (detB)I  +  tr(^)B  -  \  tr(**2)I  +  \  tr{^.  tr(yl)}I.  (2.5.78) 

However,  using  eq(2.5.77b)  with  B  =  A,  we  also  have 

A2  =  tr (A)A  -  (deU)I  (2.5.79a) 

so  that 

tr  (A2)  =  tr[tr(y*Vl  -  (deb4)l]l  (2.5.79b) 

*  [(tr«A)2  -  tr(deu4.) }  I  (2.5.79c) 

And  so, 


Q  =  [tr A  +  tiB]B  -  (detB)I  -  \  tr[tr {A)A  -  (detyl)l]l  +  \  ti{A  tr(^)}I. 

(2.5.80) 

But,  using  the  relations 

tr[(det®4.)l]  =  J  (det»4.)I  =  (2d t\A)  (2.5.81a) 
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and 


trftrCA)^}  =  tr{aAtr(aA) } 


(2.5.81b) 


in  eq(2.5.80),  we  obtain 

Q  =  [tr**  +  tiB]B  -  (detfi)I  +  (deU)I.  (2.5.82) 

And  so,  using  eqs(2.5.74a)  and  (2.5  .82),  eq(2.5.70)  becomes 

(A]p  =  PQ1  (2.5.83a) 

=  {CB  -  [A  -  ovU]C)  {[tr,A  +  t(B]B  +  [det^  -  detBll}'1  (2.5.83b) 

which  is  the  result  expressed  by  eq(162)  of  ref  [10]. 

We  are  not  aware  of  a  reference  for  the  solution  of  the  J=3  case.  In 
Appendix  B,  however,  we  also  show  that  for  J=3 

P  =  [tnA+tiB]CB  +  [  \  (deu*)  -  (detB)]C  -  ^CB  (2.5.84a) 

and 

Q  =  [tr«*+tiB][(trB)B-(detB)I]  -  (detB)B  + §  (deU)B  +  \  (\iA)(dctA)l 

-  (deU)I  -  l^trA)2\  +  \  [tr^l]3I  (2.5.84b) 

Using  eqs(2.5.84)  in  (2.5.70) 

[&]p  =  PQ*1  (2.5.85a) 

=  { [tr^l+trB]CB  +  [  \  (deu*)  -  (detB)]C  -  *ICB  } 

•  { [tr«A+tiB][(trB)B-(detB)I]  -  (detB)B  +  \  (deU)B  +  \ 

(tr*4.)(detaA)I  -  (det^)I  -  \(trA)2+  \  [tr»*J3I }  (2.5.85b) 

We  now  summarize  the  pertinent  equations  in  the  Strand-Nuttall  algorithm. 
The  initialization  begins  with  eqs(2.5.44)  expressed  as 
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(2.5.86a) 


E„  =  F0  =  £  |  £o(k)^(k)  =  i  J,  fifl(k)&S(k) 
1  N 

sm  I i(k)iH(k). 
w  k»l 


(2.5.86b) 


The  estimated  time-averaged  error  covanance  matrices  of  eqs(2.5.47)  are 
now  updated  using 


[Aff]p-,=N^  XBp.,00^1® 

K  k=p+l 

=p^  Z£p-i(k)fi"i(k-0 

y  k=p+l 

i  N  u 

$bb]p-i  =  M^  Ifip-,(lc-l)ftp-i(k-l). 
F  k=p+l 


(2.5.87a) 

(2.5.87b) 

(2.5.87c) 


We  now  determine  (£f]p.i  and  (ItJp-1  using  eqs(2.5.37)  from  the 
Levinson- Wiggins -Robinson  recursion.  Their  inverses  provide  the  weights  Ap_j 
and  £2p_j  as  noted  by  eqs(2.5.60)  and  (2.5.61);  ie., 


(2.5.88a) 


and 


(2.5.88b) 


a,H 


The  partial  correlation  matrix  denoted  as  [A]p 


can  now  be  determined 


using  eqs(2.5.58)  and  (2.5.59);  ie., 


[i]p^H  +  bh[A]”=  ch 


(2.5.89) 


A  H 

where  again  [A]p  is  recognized  as  an  estimate  since  limited  data  is  being  used  and 


(2.5.90a) 


AH  =  [V^JH  [Abb)p.,(Vp1.1]  £2"p., 

Bh  =  AjJ_)[Ujii]I1[ft(f]p.|  (Up1.,)  (2.5.90b) 

CH  =  [ftfbV.tV^Mflp1.,)  +  (A'^ltU^lH^lp., .  (2.5.90c) 


FiDm  eqs(2.5.35)  and  (2.5.36),  we  have 

[A]”  =[A']p 

(2.5.91a) 

[rf]p  =Ap(p)  = -(A]p  {(Ib]p.,) 

(2.5.91b) 

[rb]p  =  Bp(P)  =  -  (AjpUifip.,}4. 

(2.5.91c) 

We  can  now  update  the  forward  and  backward  error  covariance  matrices 
using  eqs(2.5.37)  where 

[Zf)p  =  { I  -  Ap  (p)  Bp  (p) }  (Zflp.,.  (2.5.92a) 

[lb)p  =  { I  -  Bp  (p)Ap  (p) }  (Sb]p.,.  (2.5.92b) 

Eqs(2.5.42)  and  (2.5.43)  are  now  used  to  obtain  the  update  for  gp(n)  and 
fip(n);  ie., 

£p(n)  =  £p.,(n)  +  Ap  (p)  Qp.,(n-1)  (2.5.93a) 

and 

ttp(n)  =  Bp.|(n-1)  +  Bp  (p)  £p.,(n).  (2.5.93b) 


In  this  manner,  the  recursion  is  continued  until  the  desired  order  is  reached. 

In  this  chapter,  we  have  provided  a  brief  mathematical  description  for 
several  important  linear  prediction  error  filters  (PEP).  These  include  the 
multichannel  forward  and  backward  prediction  error  filters  which  utilize  a 
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transversal  (tapped  delay  line)  structure  as  well  as  the  multichannel  lattice  filter. 
As  note!  previously,  these  filtering  operations  are  used  in  the  implementation 
architectures  for  the  multichannel  likelihood  ratios  discussed  in  chapter  6.  We 
also  presented  a  preliminary  discussion  of  the  complex  processes  which  we 
consider  in  this  dissertation.  These  include  the  autoregressive  (AR)  processes 
which  provide  a  parametric  discretion  of  the  processes.  Finally,  we  presented  a 
derivation  of  the  I-evinson*Wiggins-Robinson  and  the  Strand*Nuttall  algorithms 
including  a  summary  of  the  specific  equations  used  in  the  recursion  procedure. 
In  this  dissertation,  the  Strand*Nuttall  algorithm  is  used  to  provide  the  estimates 
of  the  AR  process  parameters  which  in  turn  are  used  to  set  the  weights  in  the 
prediction  error  filters  described  in  chapter  6.  Whereas,  the  Levinson-Wiggins- 
Robitifton  algorithm  is  used  in  a  process  synthesis  procedure  described  in  chapter 
4. 
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CHAPTER  3  THE  MULTICHANNEL  BINARY  DETECTION 

PROBLEM 


In  this  chapter,  we  first  define  the  multichannel  detection  problem  using 
complex  Gaussian  baseband  processes.  In  chapter  6,  we  will  derive  likelihood 
ratios  for  this  problem.  Second,  we  provide  a  description  of  the  associated 
bandpass  processes  and  discuss  the  conditions  under  which  these  processes  are 
stationary.  The  motivation  for  this  description  is  due  to  the  fact  that  in  chapter  6, 
we  develop  likelihood  ratios  which  are  applicable  for  a  more  general  class  of 
Gaussian  processes  for  which  the  bandpass  processes  are  non-stationary. 

3.1  DISCUSSION  OF  THE  DETECTION  PROBLEM  FOR 
BASEBAND  PROCESSES 

In  this  section,  we  define  the  multichannel  binary  detection  problem  in 
which  the  discrete-time  received  baseband  observations  are 

Ho:  &(n)  =  £(  i.(n)sd(n)  n  =  1,2 N,  (3.1.1a) 

Hp  A(n)  =  £(n,i  +  £(n)  +  jv(n)  n  ~  1,2,...,N  (3.1.1b) 

where  i(n)  is  a  complex  Gaussian,  zero  mean,  wide-sense  jointly  stationary  Jxl 
received  observation  vector  consisting  of  observations  from  J  ch  innels  and  is 
defined  as 

*T( n)  =  [Xj(n)  x2(n) ...  Xj(n)]  (3.1.2) 

where  xj(n)  j  *  1,2,...,J  is  a  scaler  observation  on  channel  j  at  time  integer  n.  The 
detection  problem,  therefore,  is  to  select  between  hypotheses  H0  and  using  the 
available  observation  processes  &(n). 

The  vectors  $(n),  £(n)  and  w(n)  are  zero  mean,  complex  Gaussian  random 
Jxl  vector  processes  describing  the  signal,  non-white  noise(clutter)  and  white 
noise,  respectively.  Hi  and  Hq  denote  the  hypotheses  under  which  the  signal  is 

present  or  absent,  respectively.  The  vector  d(n)  denotes  the  total  disturbance 
process  consisting  of  the  clutter  and  additive  white  noise.  The  vector  processes 
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i(n)  and  £(n)  each  contain  an  arbitrary  correlation  in  time  and  between  channels. 
In  addition,  correlation  can  be  considered  between  $(n)  and  past  values  of  £(n) 
and  &(n).  In  feedback  communication  and  control  problems,  the  signal  may  be 
affected  by  past  signal  as  well  as  current  and  past  noise,  so  that  [21] 


„  f  [0]  n<k 

E(S(n)KH0c)]-{Rjw(n.k)  n*k.  (3.1.3) 

In  the  radar  problem  (or  active  sonar),  the  signal  may  be  affected  by  the  presence 
of  multiple  reflections  from  the  background  environment  termed  multipath  (or 
reverberation)  [40].  Thus.,  in  general,  the  signal  contains  correlation  with  current 
and  past  values  of  the  clutter  such  that 


„  f  [0]  n<k 

E[s(n)£H(k)]  =  |R^(nk)  n2k 


(3.1.4) 


Finally,  the  vector  ^.(n)  is  uncorrelated  with  itself  in  time,  but  not 
necessarily  across  channels,  so  that 

„  [[0]  n*k 

Ete(n)ffiH(k)]  =  {Rww(0)  n=k  (3.1.5) 

where  Rww(0)  is  the  JxJ  correlation  matrix  of  Mn)  specifying  the  correlation 
across  channels. 

Next,  we  introduce  the  quadrature  form  of  *(n)  and  expressed  it  as 

*(n)  =  *i(n)  +  j  iq(n)  (3.1.6) 

where  a.,(n)  and  iq(n)  are  the  in-phase  and  quadrature  components  of  &(n), 
respectively,  and 

&(n)  =  [xu(n)  x2I(n) ...  Xjj(n)] 

*q( n)  =  [x1Q(n)  x2Q(n) ...  xJQ(n)]. 
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(3.1.7a) 

(3.1.7b) 


As  noted  above,  the  detection  problem  is  the  selection  between  hypotheses 
H0  and  Hj  using  the  available  observation  processes  *(n).  As  noted  in  chapter  2, 

we  assume  that  the  processes  &(n)  have  a  parametric  model  descripton  such  as  the 
autoregressive  (AR)  or  autoregressive  moving-average  (ARMA)  models.  In  our 

detection  procedures,  we  utilize  the  filtering  methods  and  estimation  algorithms 
discussed  in  chapter  2  to  obtain  prediction  error  vectors  £p(n),  n=l,2,...,N. 

These  error  vectors  have  a  causally  invertable  relationship  with  and  are  therefore 
statistically  equivalent  to  the  vectors  i(n).  In  chapter  6,  we  develop  likelihood 

ratios  which  are  computed  using  these  error  vectors  and  compared  to  a  threshold 
level  Yb  in  order  to  determine  the  hypothesis.  A  block  diagram  of  the  detection 

and  estimation  analysis  procedure  used  in  this  dissertation  is  shown  in  Fig.  3.1. 
As  noted  above,  we  assume  that  the  baseband  processes  are  wide-sense  jointly- 
stationary.  In  Appendices  N  and  O,  we  show  that  the  condition  of  wide-sense 
joint  stationarity  on  the  narrowband  bandpass  processes  provides  specific 

relationships  between  the  auto-  and  cross-correlation  sequences  of  the  in-phase 
and  quadrature  components  x.i(n)  and  ^(n),  respectively.  Thus,  a  more  general 

class  of  processes  results  (for  which  the  corresponding  bandpass  processes  are 
non-stationary)  when  we  have  a  more  general  correlation  between  the  quadrature 
components  of  the  complex  process  &(n).  In  section  6.3,  we  develop  likelihood 
ratios  for  the  more  general  class  of  Gaussian  processes  where  the  corresponding 
bandpass  processes  are  non-stationary. 

3.2  DESCRIPTION  OF  BASEBAND  AND  BANDPASS  PROCESSES 

The  baseband  processes  are  obtained  by  processing  a  bandpass  process  of 
spectral  width  B  positioned  about  some  carrier  frequency  fc.  In  this  dissertation, 

we  will  primarily  consider  B  to  be  small  with  respect  to  fc.  However,  a 

generalization  to  the  case  where  this  assumption  is  relaxed  will  also  be  made.  We 
denote  the  ith  channel  continuous-time  bandpass  process  at  time  t  as 

xiBp(t)  =  Re[xj(t)  exp(jcoct)]  (3.2.1) 
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where  the  angular  frequency  coc=2Jtfc.  Since  Xj(t)  is,  in  general,  complex,  we 
can  express  it  as 

*i(t)  =  *ii(t)  +  j  xjQ(t)  (3.2.2) 

where  Xji(t)  and  xjg(t)  are  the  in-phase  and  quadrature  components  of  Xj(t), 
respectively,  both  with  respect  to  the  carrier  frequency  fc.  We  can  now  express 


eq(3.2.1)  as 

XiBp(t)  “  Re  { [xii(t)  +  j  XiQ(t)]exp(jcoct) }  (3.2.3a) 

=  Xi!(t)cos((oct)  -  XjQ(t)sin((oct).  (3.2.3b) 

Alternatively,  we  can  also  express  Xj(t)  in  polar  form  such  that 

Xj(t)  =  Ai(t)exp[j0i(t)]  (3.2.4) 

where  the  amplitude  Aj(t)  is  expressed  as 

Aid)  =  -J  x?,(t)+x?Q(t)  (3.2.5a) 

and 

0j(t)  =  tan'HxjQ^/xj^t)].  (3.2.5b) 


The  baseband  process  Xj(t)  contains  all  the  information  about  the  process. 

The  discrete-time  form  of  the  quadrature  components  expressed  in  eq(3.2.2)  can 
be  obtained  using  the  quadrature  carrier  multiplexing  network  depicted  in  Fig. 
3.2.  The  low-pass  filters  are  implemented  to  remove  double  frequency  terms  and 
each  filter  has  a  bandwidth  B/2  for  noise  reduction.  Finally,  a  sampler  is  used  to 
obtain  the  discrete-time  quadrature  components  xjj(n)  and  xjq(n). 

It  is  also  useful  to  consider  the  real  concatenated  2Jxl  observation  vector 
process  i(n)  consisting  of  the  quadrature  components  of  *(n);  ie., 
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(3.2.6) 


where  the  quadrature  components  are  defined  in  eqs(3.1.7).  The  correlation 
matrix  for  this  vector  is 


R„(D  =  H(x(n)£T(n-l)] 


-  e(  K))JiVl)^(n-l)] } 


(3.2.7a) 

(3.2.7b) 


Rxd)  r!P<I) 

Rx'(l)  R^d) 


(3.2.7c) 


The  JxJ  block  correlation  matrices  in  eq(3.2.7c)  are  expressed  as 

Rf  (I)  =  E(sA(n)sJ(n-l))  A=I,Q  B=I,Q.  (3.2.8) 

We  define  the  lxl  autocorrelation  (i=k  and  A=B)  and  cross-correlation 
(i*k  and/or  A*B)  sequences  of  the  quadrature  components  as 

AO  w 

Rx^O)  =  E[xiA(n)x^(n-l)]  A=I,Q  B=I,Q  all  i,k=l,2,...J  (3.2.9) 

where  the  subscripts  i  and  k  denote  the  channels. 

In  Appendices  N  and  O,  it  is  shown  that  the  narrowband  multichannel 
bandpass  processes  corresponding  to  these  baseband  processes  are  jointly  wide- 
sense  stationary  processes  when  the  quadrature  components  satisfy  the  specific 
constraints 

RxJI)  =  R^O)  all  i,  k=l,2 . J  (3.2.10a) 

and 

R^O)  -  -  Rx^(l)  all  i,  k=l,2 3.  (3.2. 10b) 
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The  condition  of  wide-sense  stationarity  on  the  baseband  processes  is 
assumed  throughout  this  dissertation.  In  general,  however,  these  specific 
correlation  relationships  among  the  quadrature  components  do  not  necessarily 
hold.  Thus,  the  bandpass  processes  may  not  be  jointly  wide-sense  stationary.  In 
chapter  6,  we  develop  a  likelihood  ratio  not  only  for  the  special  case  described  by 
eqs(3.2.10),  but  also  for  the  case  of  the  more  generally  correlated  observation 
processes. 

We  now  consider  the  complex  auto-  and  cross-corTelation  functions  and 
develop  some  useful  properties  of  these  functions  for  the  special  case  given  by 
eqs(3.2.10).  For  jointly  wide-sense  stationary  processes,  the  complex  cross- 
correlation  (i#c)  and  autocorrelation  (i=k)  sequences  are  expressed  (using  the 


complex  conjugate  operation  *)  as 

RXik(l)  =  E[x,(n)xk(n-I)]  (3.2.11a) 

=  E{[xn(n)  +  j  x^njHx^n-l)  -  jxkQ(n-l)]}  (3.2.11b) 

=  (E[x11(n)xkI(n-l)  ]  +  E[xiQ(n)xkQ(n-!)] } 

+  j  { E[xiQ(n)xkI(n*l)]  -  E[xn(n)xkQ(n-l)] }  (3.2. 1 1  c) 

=  (r'4<I)  +  R^d))  +  j|R?*(l)  -  r!£(D)  (3.2.1  Id) 

=  RxCaffi  +  jRxDil(l)  (3.2.1 1  e) 

where 

RxCu,®  =  R“uc®  +  (3.2.12a) 

RxD*©  =  R?i(D  •  Rx?k(D.  (3.2.12b) 

For  wide-sense  stationary  baseband  processes,  we  have  the  property  that 

RX„(I)  =  Rx  (-1).  (3.2.13) 

Aik  ki 
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We  will  now  consider  the  case  of  the  observation  processes  on  a  single 
channel.  In  this  case,  we  set  k=i.  Substituting  eq(3.2.11e)  with  k=i  into 
eq(3.2.13),  we  obtain 


Rxca(i) + j  R*d„(I)  -  Rxcu(-I>  -  j  Rxdu(-i> 
so  that 

(3.2.14) 

RxCjj©  =  Rxcu(-D 

(3.2.15a) 

and 

RxD  ..(1)  =  -  Rxd.(-I). 

(3.2.15b) 

Thus,  RxC..(l)  and  RxD..0)  are  even  and  odd,  respectively.  The  property  stated  in 

eq(3.2.13)  also  holds  for  the  autocorrelation  sequences  of  the 
quadrature  components,  so  that 

in-phase  and 

RxjjO)  =  [Rxu(-D]  =  Rxu(-I) 

(3.2.16a) 

and 

R^(D  =  [R^(-D]'  =  R^(-l) 

(3.2.16b) 

which  indicates  that  these  sequences  are  even.  At  this  point,  no  conclusion  can  be 
made  regarding  the  even  or  odd  nature  of  the  cross -correlation  sequences  of  the 
in-phase  and  quadrature  components.  However,  expressing  these  sequences  in 
terms  of  their  even  and  odd  components,  we  obtain 

R?iO)  =  [R®(D]«.  +  [R®d)U  • 

Noting  that  Rxy(l)  =  R?*(-l)  and  using  eq(3.23),  it  follows  that 

(3.2.17) 

r”(I)  =  [R®(-D]  -  [R®(-I)]«n +  [R®  (-DU  • 

(3.2.18) 

Applying  the  property  of  even  and  odd  functions  to  the  RHS  of  eq(3.2.18), 
however,  we  obtain 
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(3.2.19) 


Solving  for  [R^fl)]^ 


in  eq(3.2.17)  and  substituting  into  eq(3.2.19),  we  have 


R$©  =  [R® (DL»  -  (  R® (!)  •  r R® 0)]even  }  (3.2.20a) 

=  -  R®(0  +  2[R?',(l)]eve„ .  (3.2.20b) 

r  QI  i 

A  similar  equation  can  be  obtained  by  solving  for  [Rxii(l)Jcven  in  eq(3.2.17)  and 
using  it  in  (3.2.19),  so  that 

r”(I)  =  R®(D  -  2[R*(I)]o41  .  (3.2.21) 

IQ 

These  last  two  equations  show  the  explicit  dependence  of  Rxu(l)  on  the  even 
and  odd  nature  of  R?*.(l).  When  eq(3.2.10b)  holds,  so  that  Rx?.(l)  =  -Rx*(l),  it 

follows  that  [Rxy(l)]odd  must  equal  R?~(l).  Thus,  Rx*(l)  is  odd  for  this  special 


case. 

In  this  chapter,  we  have  defined  the  detection  problem  addresses  in  this 
dissertation.  In  addition,  we  have  introduced  and  discussed  the  complex 
observation  processes  as  well  as  their  quadrature  components.  A  general 
overview  of  the  detection  analysis  approach  was  then  presented.  Finally,  both  the 
baseband  and  bandpass  processes  were  described.  Of  particular  note,  were  the 
constraints  involving  the  correlation  of  the  quadrature  components  leading  to  the 
condition  of  wide*sense  joint  stationarity  of  the  bandpass  processes.  This 
condition  is  described  in  detail  in  Appendices  N  and  O. 


CHAPTER  4  SYNTHESIS  OF  MULTICHANNEL 
AUTOREGRESSIVE  PROCESSES 


4.1  INTRODUCTION 

The  modeling  of  multichannel  time  series  has  been  given  considerable 
attention  since  the  classic  work  of  Wiener  [30].  However,  as  noted  in  [31],  the 
utility  of  such  models  is  dependent  upon  their  suitability  for  the  intended 
investigation.  The  objective  here  is  the  development  of  a  mutichannel  time  series 
methodology  for  the  synthesis  of  multichannel  autoregressive  (AR)  processes. 
The  synthesized  processes  will  be  employed  as  observation  data  processes  for  the 
simulation  and  performance  evaluation  of  multichannel  detection  and  estimation 
problems.  These  problems  involve  vector  observation  processes  containing 
random  signals  in  additive  noise  disturbances  such  as  clutter,  reverberation  and 
thermal  white  noise.  It  is,  therefore,  essential  that  we  tailor  our  modeling 
procedure  to  control  process  parameters  such  as  temporal  and  cross-channel 
correlation,  the  process  variance,  the  channel  signal-to-noise  ratio  (SNR)  and 
clutter-to-noise  ratio  (CNR).  In  the  evaluation  of  multichannel  detection  and 
estimation  methods  [2,127],  the  procedures  described  in  this  chapter  provide  a 
means  to  assess  performance  capability  in  terms  of  a  receiver  operating 
characteristic  (ROC)  by  allowing  for  variations  in  these  parameters. 

In  the  method  presented  here,  complex  auto-  and  cross-channel  correlation 
functions  are  described  in  terms  of  a  function  of  process  characteristics  such  as 
temporal  and  cross-channel  correlation  coefficients  as  well  as  the  process 
variances.  Necessary  constraints  for  realizability  of  the  correlation  functions  are 
provided.  These  functional  forms  are  used  in  the  multichannel  Yule-Walker 
equation  to  solve  for  the  matrix  coefficients  of  the  AR  process  via  the  Levinson- 
Wiggins-Robinson  recursion  algorithm  [6].  Utilizing  the  coefficients  in  the 
multichannel  AR  linear  difference  equation,  the  vector  processes  are  generated. 
Thus,  the  resulting  processes  provide  a  'fit'  to  the  parameterized  correlation 
functions  in  a  minimum  mean  squared  error  (MMSE)  sense.  A  procedure  is  also 
described  which  enables  the  generation  of  processes  consisting  of  sums  of  AR 
processes  in  additive  white  noise.  Finally,  a  method  is  proposed  to  synthesize 
complex  processes  with  jointly  Gaussian  quadrature  components  with  more 
general  auto-  and  cross-correlation.  The  resulting  processes  represent  more 
general  complex  process  where  the  associated  bandpass  processes  are  non- 


66 


stationary.  Results  are  presented  for  two-channel,  vector  processes  using  several 
values  of  temporal/cross-channel  correlation  parameters  and  process  variances  as 
well  as  their  estimated,  time-averaged  auto-  and  cross-channel  correlation 
functions. 

4.2  DEFINITION  OF  THE  VECTOR  PROCESS 

We  again  consider  the  discrete  complex  Gaussian  vector  process  &(n) 
presented  in  section  2.1  such  that 

&(n)  =  &(n)  +  £(n)  +  i(n)  n  =  1,2 . N  (4.2.1a) 

=  &(n)  +  d(n)  n  =  1,2 . N  (4.2.1b) 

where  &(n)  is  a  discrete,  zero-mean,  wide-sense  jointly  stationary  Jxl  received 
baseband  observation  vector  consisting  of  observations  from  J  channels  and  $(n), 
£(n)  and  jy(n)  are  zero  mean,  complex  Gaussian  Jxl  vector  processes  describing 
the  signal,  non-white  interference  (clutter)  and  white  noise,  respectively.  The 
vector  d(n)  is  the  summation  of  the  clutter  £(n)  and  white  noise  y^(n)  vectors  and 
is  referred  to  as  the  disturbance  vector.  In  the  synthesis  procedure  presented 
here,  these  vectors  are  assumed  to  be  uncorrelated  with  each  other.  However,  in 
section  8.2.6,  a  method  is  suggested  to  correlate  $(n)  with  past  values  of  £(n)  and 
w(n)  to  r  jl  physical  conditions  such  as  feedback,  radar  multi-path  or  sonar 
reverberation.  The  vector  w(n)  is  uncorrelated  in  time,  but  not  necessarily 
across  channels.  The  vector  processes  &(n)  and  £.(n\  however,  contain  an 
arbitrary  correlation  both  in  time  and  between  channels. 

As  noted  previously,  the  vector  processes  s(n)  and  £(n)  are  generated  as 
multichannel  autoregressive  processes;  ie.,  the  multichannel  Jxl  vector  process 
g(n)  with  g=s,c  is  expressed  as 

Mg 

*(n)  =  -5*  A ? (k)g(n-k)  +  ug(n)  g  =  s,c  (4.2.2) 

k»i 

where  Ag  (k)  is  the  kth  JxJ  matrix  coefficient  for  AR  process  g(n)  of  model  order 
Mg  and  Ug(n)  is  a  Jxl  forward  white  noise  driving  vector  with  covariance  matrix 
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[Zf]u  .  We  express  Ag  (k)  in  terms  of  the  Hermitian  operation  for  notational 

convenience,  but  here  it  is  not  constrained  to  be  a  Hermitian  matrix.  Using  a 
Cholesky  or  LDLH  decomposition  of  [Zf]u^.  the  vector  iig(n)  can  be  expressed, 

respectively,  as 

Ug(n)  =  CVgig(n)  g  *  s,c  (4.2.3a) 

or 

Ug(n)  ■  Lv^ig(n)  g  =  s,c,  (4.2.3b) 

where  y,g(n)  and  ig(n)  are  Jxl  white  noise  vectors  with  the  JxJ  identity  covariance 
matrix  I  and  diagonal  JxJ  covariance  matrix  Dv^,  respectively.  Finally,  we  can 

also  obtain  cross-channel  correlation  on  the  additive  white  noise  vector  process 
^(n)  using 

a£(n)  =  C^Cn)  (4.2.4) 

where  ^(n)  is  a  Jxl  white  noise  vector  and  the  JxJ  matrix  Cw  specifies  the  cross 
channel  correlation. 

4.3.  CORRELATION  FUNCTION  SHAPING  APPROACH 


4.3.1  General  Development 

Consider  the  autocorrelation  function  Rgn(l)  and  cross-correlation  function 
Rff  (I)  for  the  ith  and  jth  channel  processes.  We  now  consider  modeling  Rg  (I) 

frjj  •n 

and  R„  (I)  with  functional  forms  that  will  enable  us  to  obtain  a  variety  of  spectral 
•U 

distributions.  We  express  both  of  these  functions  in  a  unified  form  as 


Rgij(l)  »  E[gi(n)g*(n  - 1)] 

-  K*uVV''Vexp{j%(,)) 


(4.3.1a) 

(4.3.1b) 


68 


g-s,c. 


The  quantity  Xgj^  is  defined  as  the  temporal  cross-correlation  parameter  for  i#j 

and  the  temporal  autocorrelation  parameter  for  i*j.  It  provides  a  measure  of  the 
correlation  between  discrete  samples  of  the  process  on  a  given  channel(i=j)  or 
between  channels  (ifcj);  lg(^  is  the  lag  value  at  which  the  corresponding  real 

function  fg(*)  has  a  peak  value  of  unity.  We  note  that  the  cross-correlation 

function  does  not  necessarily  peak  at  lag  zero  as  the  autocorrelation  function 
does;  ie.  for  i*j,  lgjl  ■  0.  The  function  fgO)  is  selected  to  specify  the  shape'  of  the 

correlation  function  magnitude  and  will  be  considered  below.  The  constant  Kg..  is 

a  real,  normalizing  coefficient.  Normalizing  eq(4.3.1b)  so  that  Rg..(0)  ■ 

(p„  )au  og  enables  us  to  obtain  (see  App  •  ■  w  Q  or  ref  [3]) 

b|j  ftij  ojj 


Rg..(l)  - - - “-exp(j[0  ,(l)-9  (0))} 

g=s,c 

(4.3.2a) 

Ipa  JOg ..a2..f2(Xe..,l  -  L.) 

=  “  8,1  “  *'!  ,J  expyfe  (1)]) 

"  *gij^l=0  1J 

g  =  S,c 

(4.3.2b) 

where,  by  definition  [3], 

Pg  =  lpe  J  exp(je„  (ft)]  g  =  s,c. 

6|j  6|j  fcij 

(4.3.2c) 

Expressions  for  Re  (1)  are  obtained  from  eq(4.3.2b)  using  the  property 
®ji 

R,  (l)=R*  (-1). 

6jt  6ij 

(4.3.3) 

These  equations  provide  us  with  a  useful  description  of  the  cross- 
correlation  function  in  term  of  the  cross-correlation  coefficient  p<,  ,  the  standard 

Bij 

deviations  o„  and  of  the  channel  i  and  j  processes,  respectively,  and  the 

Sjj  6jj 

temporal  cross-correlation  parameter,  .  For  the  autocorrelation  function 
(i=j),  we  have  lpe .1=1  since  any  given  channel  process  is  totally  correlated  with 

®ii  '  ' 
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itself  at  zero  lag.  Also,  0P  (0)  =  0  since  0ff  (I)  is  an  odd  function  of  I.  Since  the 

6ii  £ji 

function  fg(*)  for  the  autocorrelation  function  has  a  peak  value  of  unity  at  1=0 
and  again  noting  that  L  =  0,  eq(4.3.2b)  for  i=j  reduces  to 

©ii 

Rgu(l)  =  «5g..fg(XgiiJ)exp{j0gii(l)}  g=s,c.  (4.3.4) 


2 

At  I  »  0,  eq.(4.3.4)  becomes  Rg..(0)  =  Cg^  which  is,  as  expected,  the  variance  of 
the  zero  mean,  channel  i  process. 

In  the  above  discussion,  we  have  proposed  the  use  of  functional  forms  to 
characterize  the  magnitude  and  phase  of  the  correlation  functions.  The  motivation 
for  this  approach  is  that  it  will  allow  for  flexibility  in  modeling  random  processes 
with  various  correlation  and  spectral  shape.  We  note,  however  that  at  this  point 
we  have  not  constrained  these  functions  to  meet  all  the  criteria  that  are  necessary 
and  sufficient  to  characterize  correlation  functions.  In  fact,  determining  all  of 
these  conditions  in  a  general  formulation  is  a  difficult  task.  In  section  4.4.1,  we 
note  several  constraints  for  the  correlation  functions  including  the  important 
condition  of  positive  semi-definiteness  of  the  correlation  matrix.  A  more 
complete  discussion  is  presented  in  [3]. 

EXAMPLE  Gaussian  Shaped  Correlation  Functions 

In  [3],  the  special  cases  of  Gaussian,  exponential  and  sine  shaped  correlation 
functions  are  considered  using  the  forms  given  in  eqs(4.3.2b)  and  (4.3.4).  For 
cross-correlation  functions  with  Gaussian  shaped  magnitudes,  for  example,  we 
use 

VV 1  -  W  *  VV  8  =  s.c  (4.3.5) 


so  that  eq(4.3.2b)  becomes 


Rg.d) 


lpg„tag„qEii(W(''W' 


*ij 


exp{j0g.(l)}  g  =  s,c. 

©ij 


(4.3.6) 
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For  the  autocorrelation  function  (i=j)  with  Gaussian  shaped  magnitudes,  we 
have  (dropping  the  subscript  i  for  notational  convenience) 

Rg(l)  =  Cg  fg(Xg,l)expUeg(l)]  =  Gg  (Xg)1  exp[j0g(l)]  g=s,c  (4.3.7) 

where 

fg(Xg,l)  =  (Xg)'  =  exp[- 2it2pgT2l2]  g  =  s,c  (4.3.8a) 

and 

Xg  =  exp[-27i2p.gT2]  g  =  s,c  (4.3.8b) 

is  a  real  constant  such  that  0  <  Xg  <  1  and  T  is  the  sample  period.  In  Appendix  R 

2 

and  ref  [3],  we  show  that  pg  with  g=s,c  is  the  variance  (which  determines  the 

width)  of  the  corresponding  Gaussian  shaped  spectra.  If  these  expressions  are 

2 

normalized  by  the  white  noise  variance  aw,  we  can  obtain 


rs0)  =  RS(D  lal  =  (S/R)f,(X,,l)  exp[j0s(l)]  (4.3.9a) 

and,  assuming  c(n)  and  w(n)  to  be  uncorrelated, 

rd(l)  =  rc(l)  +  rw(l)  (4.3.9b) 

=  Rc(l)  /ol  +  Rw(l)  /cl  (4.3.9c) 

=  (C/R)  fc(Xc,l)  expOec(l)]  +  5(1)  (4.3.9d) 


2  2  2  2 

where  S/R  »  os/cw  and  C/R  =  oc/ow.  When  c(n)  and  w(n)  are  uncorrelated,  we 

2  2  2 
also  have  »  oc  +  ow. 
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4.3.2  Correlation  Functions  for  Doppler  Shifted  Processes 

For  certain  investigations  such  as  radar  and  sonar  applications,  the  expression 
for  the  correlation  functions  can  be  modified  using  a  linear  phase  shift  term  to 
explicitly  account  for  a  Doppler  center  frequency.  In  this  case,  eqs.(4.3.9a)  and 
(4.3.9d)  can  be  expressed  as 

rs(l)  =  (S/R)  fs^OexpUesCOlexpLjlTCV*!  T]  (4.3. 10a) 

and 

rd(l)  =  (C/R)  fc(Xc,!)exp(J0c(l)]exp[j27CVcl  T]  +  5(1)  (4.3. 10b) 

where  vs  and  vc  are  the  signal  and  clutter  Doppler  center  frequencies, 

respectively.  Eqs(4.3.10a)  and  (4.3.10b)  are  generalizations  of  the  forms 
suggested  in  [23]  for  real  autocorrelation  functions  to  the  complex  form. 

For  a  baseband  signal  gj(n)  on  channel  i  with  a  Doppler  shifted  frequency 

vg.,  we  can  express  this  process  as 


gj(n)  *  (gii(n)  +  jgiQ(n)}exp(j2jwg.nT]  (4.3.1 1) 

where  T  is  the  pulse  repetition  period  in  radar  applications.  The  cross-correlation 
function  between  gj(n)  and  gj(n)  is  therefore 

Rg^n.n-I)  *  E[gi(n)g* (n-l)]  (4.3.12a) 

-  E  { [gj,(n)  +  jgiQ(n)][gjI(n-l)  -  jgjQ(n-l)] } 

•  exp[j27CVglnT]exp[-j27Wgj(n4)T]  (4.3.12b) 

-  EUgiiMgjjft-l)]  +  (gjQ(n)gjQ(n-!)] 

+  j[giQ(n)gji(n-l)]  -  gu(n)gjQ(n-l)] ) 

•  exp[j27Cvg,nT]exp(-j27Wgj(n-l)T].  (4.3.12c) 

Due  to  the  wide*sense  joint-stationary  properties  of  the  quadrature 
components,  Rg^(n.n-I)  can  be  expressed  as 

Rg|J(n,n-l)  •  (Rgc,^)  jRgDIJ(,))cxp(j2n[(vgl-v|J)nT  «•  vgJIT] )  (4.3.13) 
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where  Rgc-fl)  and  Rgo ..(I)  are  defined  in  eqs  (3.2.12).  We  note  that  this  cross¬ 
correlation  function  a  function  of  I  and  nT  for  Vg^Vgj  and  therefore,  the 
processes  gj(n)  and  gj(n)  are  not  jointly  wide-sense  stationary.  This  situation 

would  result,  for  example,  when  processing  data  from  two  or  more  radar  systems 
operating  at  different  center  frequencies.  However,  since  the  time  dependent  term 
is  deterministic,  it  can  be  removed  in  the  pre-processing.  This  is  achieved  by 
selection  of  a  reference  channel  and  frequency  multiplying  the  other  channel 
signals  so  that  the  resulting  Dopplers  are  all  equal  to  that  of  the  reference.  The 
proper  frequency  multiplying  terms  are  obtained  as  follows.  First,  consider  the 
Doppler  frequency  on  channel  i  expressed  as 

2vvoi 

v„“-r  <4-3'14) 


where  v  is  the  radial  velocity  of  the  radar  target,  v0|  is  the  channel  i  carrier 

frequency  and  c  is  the  velocity  of  light.  We  therefore  have  the  relation  between 
channels  i  and  j,  such  that 


2v 

— ‘  ■  — 4  ■  — . 
vol  voJ  c 


(4.3.15) 


If  we  select  channel  i  as  the  reference  channel  so  that  vg  «  vgR  and  v0|  ■ 
vor  where  vgR  is  the  Doppler  on  the  reference  channel  and  v0R  is  the  reference 

channel  carrier  frequency,  we  have 

vfj  j  -  1,2 . J.  (4.3.16) 

And  so,  if  the  carrier  frequency  in  the  oscillator  of  Fig.  3.2  for  each  channel  j  is 
frequency  multiplied  by  its  appropriate  factor  (v0R/vwj)  prior  to  multiplexing, 

then,  all  of  the  Dopplers  will  be  equal  to  v|R  and  cq(4,3. 1 3)  reduces  to 
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(4.3.17) 


Rg|J(D  =  (RaJ)  +  jRi..(l)]expU2itvgRIT]. 

This  result  depends  only  on  lag  I  and  therefore  satisfies  the  wide-sense  stationarity 
condition.  The  preprocessing  proposed  here,  of  course,  would  be  performed 
subsequent  to  processing  stages  which  might  utilize  the  raw  Doppler  information 
contained  on  each  channel. 

In  the  process  synthesis  procedure,  we  will  make  use  of  eqs(4.3.2).  After 
translating  the  dopplers  to  the  reference  frequency,  the  functional  expression 
corresponding  to  eq(4.3.2b)  is 


V* 


fg(Xgij,l  - 


exp{  j[0Sjj(l))  }exp<J27CVgRl  T}.  (4.3.18) 


4.4.  CONSTRAINTS  FOR  CORRELATION  FUNCTIONS 


In  this  section,  we  discuss  constraints  imposed  on  the  parameters  of  the 
functional  forms  presented  in  the  previous  sections  to  ensure  that  these  functions 
yield  valid  correlation  functions. 

4.4.1.  General  Constraints 

Several  important  constraints  can  be  developed  for  stationary  complex 
processes  in  a  straightforward  manner  by  generalizing  a  discussion  noted  in  [18]. 
Specifically,  with  the  real  constant  a.  we  consider 


E[lx,(n+l)+oiXj(n)l2)  •  E||X|(n+l)+ctXj(n)]|x*(n+l)  +  ax*(n))) 

(4.4.1s) 

-  RH(0)  +o|R,j(l)  +  Rj|(-D)  +  a2Rjj(0) 

(4.4.1b) 

-  R||(0)  +o|R|j(l)  +  Rj(l)  |  +  aJRjj(0) 

(4,4.1c) 

-  R,|(0)  +  2aRe|R|j(l)l  +  alRjj(0). 

(4,4. Id) 

The  above  quadratic  is  nonnegative  for  any  a;  therefore,  its  discriminant  is 
nonpositive  so  that  from  eq(4,4,ld) 
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(RelRyfl))]2*  ^(0)^(0). 


(4.4.2a) 


Likewise,  interchanging  i  and  j  in  eq.  (4.4.1a),  we  obtain 

(Re{Rji(l))]2S  Ru(0)Rjj(0).  (4.4.2b) 


Alternative  expressions  can  be  obtained  from  eq.(4.4.1b)  such  that 

(R,j(l)  +  Rji(-I)]2  S  4R„(0)RJj(0).  (4.4.3) 


Using  eq(4.3.6)  for  the  Gaussian  shaped  cross-correlation  function  in  eq(4.4.3), 
we  can  derive  [see  Appendix  C]  the  constraint 


^g(|) 

lp“)' s  lco.ieliJ(i,u))l ' 


(4.4.4) 


The  result  expressed  by  eq(4,4,4)  provides  a  constraint  for  Ipg^l  in  terms 

of  an  upper  bound.  It  represents  one  of  several  conditions  that  must  be  satisfied 
by  complex  correlation  functions. 


4.4.2.  Positive  Seml-Deflniteneii  Condition 


The  correlation  sequences  developed  in  eqi(4,3,2)  and  (4,3.4)  are  used  to 
determine  the  elements  of  the  multichannel  correlation  matrix,  [RU]N.  This 

matrix  must  satisfy  the  condition  of  positive  semi-definiteness;  ie.  a  matrix  for 
which  all  eigenvalues  are  non-negative,  Alternatively,  all  subminor  matrices  of 
the  JNxJN  matrix  |RU)N  have  non-negative  determinants  (70,71)  leading  to  2;n-1 

constraints  for  the  terms  pg  ,  X|(j,  a g(j,  and  1^.  These  are  discussed  further 

In  0). 

It  should  be  noted  that  the  constraints  on  the  model  parameters  discussed  in 
tltls  section  provide  necessary  conditions  but  are  not  in  themselves  sufficient.  17ie 
procedure  for  the  synthesis  of  multichannel  Alt  processes  adopted  in  this 


7,1 


dissertation  is  to  utilize  eq(4.4.4)  and  then  verify  that  the  resulting  matrix  is 
positive  semi-definite.  Investigation  of  additional  constraints  is  suggested  for 
future  consideration. 

4.5.  SYNTHESIS  PROCEDURE 

In  the  single  channel  radar  problem,  efforts  have  been  made  to  model 
radar  clutter  with  AR  processes  of  relatively  low  order  [16,79,80].  The  extension 
of  these  analyses  to  the  multichannel  case  remains  an  open  area  of  research.  It 
has  also  been  noted  [36]  that  the  sum  of  two  AR  processes  or  the  sum  of  an  AR 
process  with  additive  white  noise  yi  *!ch  an  autoregressive  moving-average 
(ARMA)  process.  In  this  dissertation,  ■  c  assume  the  applicabilty  of  the  AR 
model  in  the  representation  of  both  signal  and  non-white  noise  (clutter)  processes. 
Since  we  will  also  be  considering  these  processes  and  the  white  noise  processes  in 
an  additive  manner,  we  are  therefore  also  concerned  with  the  ARMA  process. 

In  this  section,  we  discuss  the  synthesis  procedure  used  to  generate  wide- 

sense  stationary,  multichannel  autoregressive  (AR)  processes.  Since  the 
observation  process  under  the  two  hypotheses  H,  i— 0,1  will  have  different  model 

order,  the  processes  under  the  hypotheses  H,  i— 0.1  will  be  considered  separately. 

In  chapter  7,  these  synthesized  processes  will  be  used  as  observation  processes  for 
a  Monte-Carlo  analysis  in  the  performance  evaluation  of  our  multichannel 
detection  algorithm. 

In  the  process  synthesis  procedure,  we  could  elect  to  characterize  the 
observation  processes  i(nlHj)  as  multichannel  AR  processes  under  hypotheses  H0 

and  Hj  such  that 


i(nlHj)  ■  •  £  AM,(klH|)  g(n-k)  ♦  u(nlHj)  i  ■  0,1  (4,5,1) 

k«l 

where  Mi,  AM|(k!H|)  and  u(nlH|)  denote  the  model  order,  the  matrix  coefficients 

of  the  AR  process  and  the  white  Gaussian  noise  driving  tenn  under  each 
hypothesis,  respectively.  Eq  (4.5,1)  could  be  utilized  to  generate  the  processes 
under  each  hypothesis  using  coefficients  which  would  have  to  be  prc-determlncd 
In  some  ad-hoc  manner  in  order  to  vary  the  correlation  of  the  synthesized 
processes.  Furthermore,  this  approach  does  not  allow  for  Individual  control  of 
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Che  signal  and  clutter  processes;  ie.,  we  have  no  direct  control  of  the  signal  and 
clutter  temporal  and  cross-channel  correlation  as  well  as  variations  of  the  signal- 
to-noise  (S/N)  and/or  signal-to-clutter  (S/C)  ratios.  Thus,  this  approach  is  not 
considered  further  in  this  dissertation. 

In  the  approach  used  here,  the  Jxl  vectors  £(n)  and  £(n)  defined  in 
eqs(3.1.1)  are  generated  as  distinct,  multichannel  AR  processes  for  the  signal  and 
non-white  noise,  respectively.  It  is  interesting  to  note,  however,  that  each  element 
of  these  vectors  will  be  an  ARMA  process  [10,  also  section  8.2.1].  The  two 
processes  a(n)  and  £(n)  are  controlled  individually  using  the  scheme  shown  in  Fig. 
4.5.1.  This  scheme  is  somewhat  similar  to  that  suggested  in  [23]  for  scalar 
process  synthesis.  In  this  work,  however,  the  synthesis  procedure  is  generalized 
to  consider  multichannel  vector  processes  in  which  we  are  able  to  control  the 

variance  and  temporal  correlation  on  each  channel,  the  cross-channel  correlation, 
the  time  lag  lg^  between  the  processes  as  well  as  the  individual  channel  signal-to- 

noise  (SNR)  and  clutter-to-noise  (CNR)  ratios.  In  subsection  8.2.6,  a  method  is 
suggested  to  synthesize  a  multichannel  AR  process  containing  delayed  feedback  or 
radar  multi-path.  The  functions  Hg(z)  g-s,c  are  the  linear  model  filter  transfer 

functions  for  the  synthesis  of  the  signal  and  clutter  processes,  respectively.  They 
serve  to  temporally  correlate  a(n)  and  £(n)  while  the  matrices  C,,  Cc  and  Cw 

provide  the  cross-channel  correlation.  Since  ig(n),  g*s,s,w  is  Gaussian,  and 
recognizing  that  *(nlHj)  i«0,l  are  obtained  using  linear  operations,  they  also  are 

Gaussian. 

In  section  4.3,  we  discussed  a  method  to  express  the  magnitude  and  phase 
of  auto-  and  cross-correlation  functions  with  functional  forms.  A  specific 
example  of  a  Gaussian  shaped  magnitude  function  was  considered.  Once  these 
correlation  functions  have  been  specified  to  obtain  a  desired  spectral  shape,  the 
Yule-Walker  equation  can  be  used  to  determine  the  AR  coefficients  for  the 
process  with  a  model  order  chosen  to  fit  the  desired  spectrum  within  certain 
tolerance  specifications.*  In  the  procedure  used  here,  correlation  functions  for 
the  signal  and  non-white  noise  are  specified  separately  in  terms  of  Rl(j(l)  and 

Rt.^(l),  respectively,  for  l,J»l,2,..J.  The  autoregressive  power  spectral  density 


'  Daiarmlnaiion  of  (ha  modal  ordar  li  bayond  lJm  »M>pa  of  (hi*  wort,  Kara,  II U  aiiumad  lhai  (ha  modal  ordar  U 
known  or  pia  qiKlflad 
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&(nlHj)^ft(n)4fi(n)tSK(n) 

X(nlfyto(n)+£(n) 


Figure  4.5.1  Block  diagram  for  the  proceu  synthesis  procedure 
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(PSD)  which  would  result  from  the  determined  AR  coefficients  provides  a  fit  to 
the  desired  spectrum.  Alternatively,  when  these  coefficients  are  used  in 
eq(4.2.2),  we  are  able  to  generate  processes  which  provide  a  fit  to  the  desired 
spectrum  in  a  MMSE  sense.  In  this  dissertation,  however,  the  process  synthesis 
procedure  is  based  upon  the  specification  of  the  correlation  sequences.  In 
addition,  we  emphasize  that  in  this  work,  we  are  concerned  with  parameter 
estimation  rather  than  spectrum  estimation. 

Specifically,  the  following  procedure  is  used  to  generate  the  time  samples 
for  both  the  AR  signal  and  clutter  processes: 

(1)  The  desired  shapes  of  the  autocorrelation  and  cross-correlation  values 
are  obtained  using  the  f(«)  functions  by  the  methods  of  section  4.3. 

(2)  The  order  of  the  AR  process  (for  synthesis)  is  selected  based  upon  a 
specified  tolerance  for  fitting  the  desired  spectrum. 

(3)  The  values  of  R,^(l)  and  RCj,(l)  are  used  to  form  the  matrix  elements  of 

the  signal  and  non-white  noise  correlation  matrices  designated  as  Rgg  and 
Res*  respectively. 

(4)  Using  the  block  Toeplitz  form  of  [BLjM  the  multichannel  Yule- 

Walker  equations  expressed  by  eq(2.3.1)  are  solved  using  the  Levinson- 
Wiggins-Robinson  recursion  (6)  to  determine  the  matrix  coefficients 

H  H 

Ag(k)  and  the  Hermitian  driving  white  noise  covariance  matrix  Hf]U| 

for  k«l,2 . Mg.  The  matrix  Cv^  is  obtained  from  eq(2.2.6)  using  a 

Cholesky  decomposition  of  ie„ 

(£f)U|  -  CV|C»,.  (4.5.2) 

(5)  The  values  of  Ag  (k)  and  CVf  are  now  used  in  the  generation  of  i(n)  and 
g(n)  via  eqs(2.2,l)  and  (2.2.2a)  expressed  here  for  convenience;  ic., 


f  Wi  again  ihm  Uta>  uihcr  datiimpualiMii  iuth  a«  (I*  I.UI  ^  could  alto  In  u*fd  . 
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(4.5.3) 


g  =  s,c 


where 

Ug(n)  =  Cv^lg(n).  (4.5.4) 

(6)  The  vector  &(n)  is  generated  using  eq(2.2.2b)  where  Cw  can  be  obtained 
by  specifying  Rww(0)  in  eq(2.2.4c)  and  again  using  the  Cholesky 

decomposition. 

(7)  The  processes  $(n),  £(n)  and  &(n)  are  added  to  yield  &(nlH,)  or  *(nlH0)  as 
shown  in  Fig.  4.5.1. 

Thus,  the  vectors  us(n),  u<,(n)  and  ^(n)  in  Fig  4.5.1  can  be  controlled  to  be  zero- 

mean,  white  Gaussian  noise  vectors  uncorrelated  in  time  but  with  variable 
correlation  across  channels;  ie., 


H  ,  r  (o)  i  #  o 

HLug(n)Ug  (n*l)]  -  |[if]  1-0  g  ■ 

(4.5.5a) 

E(*(n)ttH(n-l)]  -  {r  ^(0) 1  \\  0 

(4.5.5b) 

where,  in  general,  the  matrices  (If]U|  and  R*w(0)  have  non-zero  off-diagonal 

components.  Again,  the  functions  Hg(z)  g«s,c  are  the  model  filter  transfer 

functions  for  the  synthesis  of  the  signal  and  clutter  processes,  respectively.  They 

serve  to  temporally  correlate  |(n)  and  &(n)  while  the  matrices  C;v  ,  Cv  and  Cw 

i  c 

provide  the  cross-channel  correlation, 

Por  illustrational  purposes,  we  now  consider  an  example  involving  a  single 
channel  AR  process  in  further  detail,  This  example  will  provide  us  with  further 
insight  regarding  the  relationship  between  the  correlation  of  the  synthesized 
processes  and  the  AR  parameters. 
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EXAMPLE 

In  this  example,  we  consider  the  synthesis  of  a  single  channel  AR  process 
of  order  two  using  real,  Gaussian  shaped  correlation  functions.  The  correlation 
function  is,  therefore,  expressed  as  (dropping  the  subscript  notation) 

R(l)  =  a2(X)12.  (4.5.6) 

The  Yule-Walker  equation  for  this  case  is 


’  R(0)  R(l)  R(2)  “ 

'  1  “ 

1 

=Qk, 

_ 1 

R(*l)  R(0)  R(l) 

a(l) 

a 

0 

i — 

po 

• 

50 

• 

50 

3 

-  att)  . 

.  0  . 

where  o2  is  the  variance  of  the  white  noise  driving  term  of  the  associated  AR 
process.  Using  the  functional  form  of  eq(4.5.6)  in  (4.5.7)  and  solving  for  the 
coefficients,  we  have 


R(2)R(-1).R(1,)R1QJ  .o 
a(1)  R(0)R(0)-R(1)R(-1)  +1) 

(4.5.8) 

Rjl)R(l)  •  R.G)R1Q1 . 
aU)  R(0)R(0)-R(1)R(-1)  A 

(4.5.9) 

o2  ■  R(0)  +  a(l)R(+l)  +  a(2)R(+2) 

(4.5.10a) 

■  o2  -  a2\2(\2  +  1 )  +  o2X6 

(4.5.10b) 

* o2[l  -  \2-\U\<>) 

(4.5.10c) 

We  now  consider  the  effect  of  these  results  when  used  in  the  AR  equation  (4.2.2) 
for  the  scalar  case;  ie., 


g(n)  ■  •  a(l)s(nl)  •  a(2)g(n-2)  u(n). 

Using  eqi(4.3.8)  and  (4.3.9)  In  (4.5.1 1),  we  have 


(4.5.11) 


g(n)  a  X(X2  +  l)g(n-l)  -  X2g(n-2)  +  u(n) 


(4.5.12) 


where  the  white  noise  driving  term  u(n)  has  the  variance  <J2.  As  X  approaches 
zero,  we  note  from  eq(4.5.6)  that  the  correlation  function  approaches  a  discrete 
delta  function  with  variance  a2.  Therefore,  g(n)  is  expected  to  be  an 
uncorrelated  white  noise  process  with  variance  a2.  Examination  of  eq(4.5.12) 
indicates  that  g(n)  is  approaching  the  white  noise  process  u(n)  for  small  X  since 
the  AR  coefficients  are  becoming  vanishingly  small.  In  addition,  eq(4.5.10c) 
indicates  that  the  variance  of  u(n)  approaches  that  of  g(n)  as  required.  We, 
therefore,  have  a  method  for  process  synthesis  that  allows  one  to  control  the 
variance  and  temporal  correlation  over  a  wide  range  of  values.  Purtherernore, 
for  a  specific  a2,  the  variance  of  the  synthesized  processes  will  remain  fixed 
independent  of  the  choice  of  X. 

4.6.  MULTICHANNEL  GAUSSIAN  PROCESSES  WITH 

UNCONSTRAINED  QUADRATURE  COMPONENTS 

In  (3),  a  procedure  for  the  synthesis  of  multichannel  AR  processes  was 
described  where  we  were  able  to  control  not  only  the  temporal  and  cross-channel 
correlation,  but  also  the  correlation  of  the  quadrature  components.  However,  the 
correlation  of  the  quadrature  components  had  to  be  achieved  by  an  ad-hoc 
method.  In  this  section,  we  present  a  direct  method  to  obtain  this  correlation 
between  the  quadrature  components  in  a  manner  that  is  more  consistent  with  that 
presented  in  the  previous  section.  Specifically,  this  method  enables  us  to  specify 
the  temporal,  cross-channel  and  quadrature  component  correlation  directly  within 
the  correlation  matrix  used  in  the  Yule-Wulker  equation. 

We  first  consider  the  real,  concatenated  2Jxl  observation  vector  j(n)  such 
that 


l(n)  * 


&,0  »)■ 


where 


(4.6.1) 


H2 


(4.6.2a) 

(4.6.2b) 


&(n)  =  [xn(n)  x2I(n) ...  Xj,(n)] 
XQ(n)  =  (x1Q(n)  x2Q(n) ...  xJQ(n)] 


and  J  denotes  the  number  of  channels.  The  correlation  matrix  for  this  vector  is 


RjjfllHj)  =  EMnlHi^n-llHi)] 


(4.6.3a) 


Rx(HHi)  RxQ(HHi) 
Rx'dlHj)  R^IIHj) 


(4.6.3b) 


where  the  JxJ  block  correlation  matrices  in  eq(4.6.3b)  are  expressed  as 
R*B(IIHj)  =  E[iA(nlHj)iB(n-IIHj)]  A=I,Q  B=I,Q  i  =  0,1.  (4.6.4) 


We  define  the  lxl  autocorrelation  (j=k  and  A=B)  and  cross-correlation 
(j*k  and/or  A*B)  sequences  of  the  quadrature  components  as 

AB  t 

Rxjk(IIHi)  =  E[xjA(nlHi)xJB(n-IIHi)]  A=I,Q  B=I,Q  i  -  0,1 


j,k=l,2 . J  (4.6.5) 

where  the  subscripts  j  and  k  denote  the  channels.  Considering  the  Yule- Walker 
equations  for  an  order  M  process  expressed  in  terms  of  the  concatenated 
quadrature  form  (see  Appendix  M.4  where  the  identical  form  of  these  equations 
for  prediction  error  filters  is  derived),  we  have 

(4.6.6) 


where  the  2J(M+1)  square  matrix  [Rn]M+1  is  expressed  as 


M+l  ”  ^^n.n-M^n.n-M^H^ 


(4.6.7a) 
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and 


tn,n-M  =  (lT(n)  IT(n-l)...tT(n-M)] 


(4.6.7b) 


IT(k)  =  (r,(k)  r2(k)...r,(k)). 


(4.6.7c) 


=  (I  ^T(l)  At(2)  ...  ^t(M)] 


(4.6.7d) 


IT  =  [I  (0]  [0] ...  (0)] 


AT(k)  = 


A[,(k)  Aj,(k) 
Aj2(k)  Aa(k) 


[£f]Ur  =  E[ur(n)uJ'(n)) 


Ur(n)  = 


Ui(n) 

UqW 


(4.6.7e) 


(4.6.70 


(4.6. 7g) 
(4.6.7h) 


where  the  elements  of  AT(k)  are  JxJ  matrices  and  the  quadrature  vectors  Uj(n) 
and  UQ(n)  are  each  Jxl.  As  an  example,  we  consider  eq(4.6.6)  expressed  in 

expanded  form  for  an  order  one  process  as 


[R?(0)1  [R?(0)1  [Rjd)]  [R?(l)] 
IR?(0)1  [R®(0)i  [R?(1)][R?J(1)] 
[Rj(-l)l  [R?(-l)]  [R«(0)1  [R?(0)1 
[R?(- 1  )][R?Q(- 1  )][R?(0)](R?Q(0)] 


"I  [0]  ’ 

[rS,(0)i  [r”(0)j 

[0]  I 

— 

[RX(0)][RM0)] 

Aji(1)Ai2(1) 

[0]  [0] 

-A21(1)A22(1)- 

-  [0]  [0]  - 

(4.6.8) 


where 


*00  = 


A 1 1 ( 1 )  A12(l)‘ 
_A21(1)  A22(l) 


(4.6.9a) 
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and 


[RujfO)]  [R?(0)] 
[R?(0)1  [R^(O)] 


(4.6.9b) 


We  now  apply  the  same  procedure  using  eq(4.6.6)  as  in  the  previous 
section;  ie.,  correlation  shaping  functions  are  used  for  each  of  the  scalar  elements 

of  [RnlM+1-  The  Yule-Walker  equations  are  then  solved  for  the  2Jx2J  matrix 

coefficients  sA(k),  k=l,2,...,M  and  A  Cholesky  or  LDLT  decomposition  of 

[Iflu  provides  the  real,  2Jx2J  matrices  Ct  and  Lp  which  serve  the  same  role  as  Cv 

and  Lz  in  the  previous  section.  In  this  case,  however,  Ct  and  Lp  are  able  to 
control  not  only  the  cross-channel  correlation,  but  also  the  quadrature  correlation 
that  was  specified  in  the  matrix  [&J  .  This  can  be  seen  by  considering 

(4.6.10) 


where  the  matrix  Ct  contains  all  the  cross-channel  and  quadrature  correlation 
information  contained  in  [If]Uf  and  the  factor  of  (1/2)  is  used  on  the  quadrature 

terms  in  order  to  provide  a  unit  variance  on  the  complex  vector  i(n)  defined 
below.  From  eq(4.6.10),  we  obtain 

c;1fffjUlc;T=  1 1  (4.6.1D 

where  I  in  this  case  is  a  2Jx2J  identity  matrix.  Eq(4.6.1 1)  can  also  be  written  as 

Cl'  [Ifl^C;1  =  E[C',Vr(n)Ur(n)C'tT]  =  \  I.  (4.6.12) 

Eq(4.6.12)  implies  the  existence  of  the  concatenated  real  vector  ^(n)  such  that 
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(4.6.13) 


lr(n)  =  C'/uj-Cn) 
and 

E[Ij(n)£r(n)]  =  5 1  (4.6.14) 


where,  again,  I  is  a  2Jx2J  identity  matrix.  From  eq(4.6.13),  we  have 


Ur(n)  =  Ct  i,-(n)  = 


l,(n) 

t[lQ(n). 


(4.6.15) 


Thus,  iij.(n)  can  now  be  generated  using  the  matrix  Ct  [which  is  available  from  the 
solution  of  eq(4.6.10)]  and  the  white  noise  vector  ij.(n).  From  eq(4.6.14),  we 


obtain  the  JxJ  matrices 

EU,(n)l[(n)]  =  jl 

(4.6.16a) 

E[tQ(n)lQ(n)]  =  jl 

(4.6.16b) 

and 

E[lI(n)^(n)]  =  [0]. 

(4.6.16c) 

From  eqs(4.6.16),  the  correlation  matrix  of  the  complex  vector 
l(n)=lI(n)+jjQ(n)  is  found  to  be 

E[l(n)IH(n)]  =  E[i,(n)tf(n)]  +  EU^n^n)]  =  I  (4.6. 1 7) 

where,  in  this  case,  I  is  a  JxJ  identity  matrix.  Thus,  the  complex  white  noise 
driving  vector  £(n)  has  unit  variance.  Likewise,  the  LDLT  of  [If]Ur  implies  the 

existence  of  pr(n)  such  that 


Ur(n)  =  Lp  pr(n)  =  Lp 


Bi(n) 

.EqCn) 


(4.6.18) 
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where 


E[jl,(n)c[(n))  = 

(4.6.19a) 

E[BQ(n)fei(n)1  = 

(4.6.19b) 

ElfcOOfejdi)]  =  [0] 

(4.6.19c) 

and  the  correlation  matrix  of  the  complex  white  noise  driving  vector 
p(n)=nI(n)+jCQ(n)  is 

E[p(n)pH(n)]  =  Dp.  (4.6.20) 

This  procedure  provides  a  practical  method  for  the  synthesis  of  ur(n).  As 
noted  above,  the  solution  of  eq(4.6.6)  also  provides  the  matrices  *4.(k), 
k=l,2,...,M.  Thus,  we  can  now  synthesize  the  concatenated  vector  process  i(n) 
using  the  concatenated  form  of  the  AR  equation 

M 

l(n)  =  -  X  •*T(k)l(n  -  k)  + 14(11).  (4.6.21a) 

k=l 
M 

=  -  2  ^T(k)i(n-k)  + 0,4(11)  (4.6.21b) 

k=l 

where  eq(4.6.21b)  follows  from  (4.6.15). 

In  this  section,  we  have  presented  a  method  for  generating  AR  processes  in 
which  we  are  able  to  control  not  only  the  temporal  and  cross-channel  correlation, 
but  also  the  correlation  between  quadrature  components.  The  method  allows  one 
to  specify  these  correlation  properties  directly  in  the  correlation  matrix  of  the 
concatenated  quadrature  form  of  the  Yule- Walker  equations  presented  in 
eq(4.6.6).  The  Yule- Walker  equations  are  then  solved  for  «4.T(k)  and  Ct  in  order 

to  synthesize  t(n)  via  eqs(4.6.21).  This  procedure  allows  us  to  synthesize  the 
more  general  processes  discussed  in  Appendix  N. 
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4.7.  SYNTHESIS  RESULTS 


In  this  section,  we  illustrate  examples  of  the  synthesized  AR  processes  in 
order  to  gain  further  insight  into  the  synthesis  method.  In  addition,  we  also 
consider  the  time-averaged  and  ensemble  averaged  auto-  and  cross-correlation 
sequences.  Both  single  channel  and  multichannel  processes  are  shown  in 
subsections  4.7.1  and  4.7.2,  respectively.  In  these  sections,  we  note  that  the  terms 
’trials'  and  'realizations’  are  used  interchangeably.  They  refer  to  a  statistically 
independent  generation  of  a  sequence  of  an  AR  process. 

4.7.1.  Single  Channel  Case 

In  this  subsection,  we  utilize  the  AR  process  synthesis  procedure  described 

in  section  4.5  to  generate  single  channel  autoregressive  processes  of  order  two. 

For  the  processes  considered  here,  the  elements  of  the  correlation  matrix  are 

specified  using  the  Gaussian  autocorrelation  shaping  function.  Their  parameters 

are  specified  in  Table  4.7.1.  These  elements  are  then  used  in  the  Yule-Walker 

equation.  The  two  AR  coefficients  and  driving  white  noise  variance  are  then 

obtained  and  used  in  the  scaler  form  of  eq(4.5.3).  This  equation  is  then  used  to 

generate  the  required  signal  processes.  For  the  processes  shown  in  Figs.  4.7.1 

through  4.7.8,  the  real,  Gaussian  autocorrelation  function  was  used.  We  note, 

however,  that  an  AR(2)  process  has  an  exponential  autocorrelation  function. 

Therefore,  in  these  cases,  we  are  generating  processes  which  provide  a  'fit'  to  the 

specified  Gaussian  autocorrelation  function  in  a  MMSE  sense.  Although  the  AR 

coefficients  can  be  shown  to  be  real,  the  processes  s(n)  generated  by  eq(4.5.3)  are 

complex  since  u(n)  is  complex.  Also,  the  resulting  spectra  will  be  even. 

In  Fig  4.7.1,  we  show  the  amplitude  of  the  real  part  of  the  AR(2)  process 

2 

using  a  temporal  correlation  coefficient  X.s=0.99  and  variances  cs  ranging  from 

2.0  to  8.0.  We  note  the  variation  in  the  amplitude  of  each  of  the  processes  as  the 
variance  changes.  In  Fi|  4.7.2,  we  show  the  amplitude  of  the  real  part  of  the 

signal  using  a  variance  os=4.0  In  this  case,  however,  we  demonstrate  the  effect 

of  varying  the  temporal  correlation  coeffient  \s  from  0.1  to  0.9999.  We  note 

that  Figs  4.7.2a  through  4.7.2c  are  plotted  for  100  samples,  while  Fig.4.7.2d  uses 
200  samples.  These  figures  illustrate  the  effect  of  Xs  in  controlling  the  sample-to- 
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Table  4.7.1  Parameters  for  single  channel  synthesized  processes 


I 


observations 


the  ARPSD  computed  using  the  AR(2)  signal  coefficients  obtained  from  the  Yule-Walker 
a.)JL=0.95  b.)  X=0.80  c.)  X=0.1. 


estimated  correlation  functions  for  the  AR(2)  signal 
0  sample  observations  with  a.)  X,=0.95  b.)  X«=0.80 


sample  correlation;  ie.,  for  Xs  approaching  zero  as  in  Fig.  4.7.2a,  the  process 
becomes  white.  However,  as  Xs  approaches  unity  as  in  Fig.  4.7.2,  the  more 

slowly  varying  function  of  time  indicates  that  these  processes  are  approaching  the 
case  of  total  correlation  sample-to-sample.  It  is  worth  noting,  at  this  time,  that 
the  imaginary  component  of  these  complex  processes  follows  the  same  behavior. 
This  can  be  shown  by  first  recognizing  that  the  signal  phase  is  expressed  as 


0s(n)  =  tan-1 


sQ(n) 

Sj(n) 


(4.7.1) 


As  noted  above,  for  Xs  approaches  unity,  the  in-phase  and  quadrature  signal 
components,  Sj(n)  and  Sq(n)  respectively,  are  each  becoming  more  slowly  varying 

functions  of  time.  Therefore,  they  are  each  approaching  constant  values  within  a 
single  trial.  Consequently,  0s(n)  approaches  a  constant.  On  the  other  hand,  as 

A,s  approaches  zero,  Sj(n)  and  sQ(n)  each  become  more  uncorrelated  in  time  so 

that  each  exhibits  random  behavior  along  the  sequence  of  a  given  realization. 
And  so,  0s(n)  is  random  in  time.  The  important  point  to  be  made  here  is  that  the 

parameter  Xs  controls  the  amplitude  as  well  as  the  phase  correlation  of  the 

process.  This  capability  will  be  utilized  in  chapter  7  to  synthesize  phase 

correlated  signal  processes.  Therefore,  we  are  able  to  investigate  the  coherent 

integration  gain  in  the  detection  algorithms  that  are  derived  in  chapter  6. 

In  Fig  4.7.3,  we  show  results  for  three  separate  trials  of  the  real  part  of  the 

2 

signal  process  for  Xs  *  0.9999  and  cs  =  4.0  over  a  window  of  200  time  samples. 

The  point  to  be  noted  here  is  the  randomness  associated  with  the  initial  amplitude 
(and  phase  via  the  previous  discussion).  As  noted,  however,  after  the  initial 
amplitude  is  selected  at  random,  the  remaining  samples  are  highly  correlated 
within  each  trial  as  governed  by  the  high  value  of  the  temporal  correlation 
coefficient.  This  feature  will  enable  us  to  model  processes  such  as  Swerling 
fluctuating  signals  [72]  in  radar  applications,  for  example. 

Fig  4.7.4  shows  the  results  of  the  model  fitting  procedure.  The  dotted 
curves  show  the  correlation  functions  prespecified  using  the  functional  shaping 
method.  The  solid  curves  are  plots  of  the  correlation  function  estimated  using 
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10,000  samples  of  the  synthesized  processes  over  40  lag  values.*  Figs  4.7.4a, 
4.7.4b  and  4.7.4c  are  plots  for  Xs  =  0.95,  0.8,  and  0.1,  respectively.  We  first 

note  the  effect  of  Xs  on  the  correlation  function;  ie.  as  Xs  transitions  from  unity 

to  zero,  the  correlation  function  ranges  from  a  slowly  varying  function  of  the  lag 
value  to  that  approaching  a  delta  function.  Next,  we  note  from  Figs  4.7.4a  and 
4.7.4b  that  the  correlation  sequences  of  the  AR(2)  process  provide  an 
approximate  fit  to  the  predetermined  correlation  function.  This  is  a  result  of  the 
fact  that  it  would  require  an  AR  process  of  infinite  order  to  model  the  Gaussian 
shaped  correlation  exactly.  These  plots  illustrate  that  the  processes  generated 
here  are  an  approximation  to  those  corresponding  to  the  predetermined 
correlation  function.  In  fact,  they  are  the  processes  that  'fit'  the  known  model  in 
a  MMSE  sense.  In  Fig  4.7.5,  we  show  the  autoregressive  process  power  spectral 
density  (ARPSD)  which  is  obtained  using  the  AR  coefficients  obtained  from  the 
Yule-Walker  equation.  Fig  4.7.6  is  the  corresponding  power  spectral  density 
(PSD)  determined  using  a  zero-filled  64  point  FFT  of  the  calculated  correlation 
functions  plotted  in  Fig  4.7.4.  The  plots  for  Figs  4.7.6a  and  4.7.6b,  show  even 
spectra  as  we  would  expect  since  the  correlation  functions  are  real.  However,  we 

also  note  the  dual  peaks  associated  with  the  poles  of  the  AR(2)  model.  The  point 
to  be  noted  here  is  the  behavior  of  the  spectra  for  various  values  of  A.s;  ie.  as  Xs 

ranges  from  unity  to  zero,  the  spectra  transitions  from  its  peaked  behavior  to  the 
broad  distribution  associated  with  white  noise  processes.  It  is  also  interesting  to 
note  that  as  Xs  decreases,  the  pronounced  pole  positions  are  diminished  as  shown 

in  Fig  4.7.6c.  This  is  a  result  of  the  fact  that  the  AR  coefficients  are  becoming 
vanishingly  small  as  noted  by  eqs(4.5.8)  and  (4.5.9). 

In  Figs  4.7.7  and  4.7.8,  we  show  plots  of  the  autocorrelation  function  and 
power  spectral  density,  respectively,  estimated  using  10,000  samples  of  the  same 
signal  process,  but  in  the  presence  of  unit  variance  additive  white  noise.  We  note 
that  the  correlation  functions  in  Fig  4.7.7  overlay  the  corresponding  functions 
shown  in  Fig  4.7.4  except  that  at  lag  zero,  they  have  increased  by  a  unit  value  due 
to  the  uncorrelated  noise  process;  ie.,  at  1=0,  the  autocorrelation  sequences  peak  at 
5  rather  than  4.  A  comparison  of  Figs  4.7.6  and  4.7.8  shows  the  increased  levels 
due  to  the  additive  noise. 


*  We  note  the  offset  in  the  display  graphics  for  the  correlation  sequence  plots. 
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4.7.2.  Multichannel  Case 

In  this  subsection,  we  consider  the  generation  of  a  two-channel  vector 
process  using  the  AR  synthesis  approach  described  in  chapter  6.  In  this  case,  the 
multichannel  Yule-Walker  equation  is  solved  for  the  forward  AR  matrix 
coefficients  and  the  forward  driving  white  noise  covariance  matrix.  These 
matrices  are  used  for  process  synthesis  following  the  method  described  in  section 
4.5.  We  limit  the  results  shown  here  to  the  case  of  real,  Gaussian  shaped 
correlation  functions.  In  this  section,  we  will  qualitatively  discuss  the  dependence 
of  ergodicity  on  the  correlation  parameters.  In  sections  5.3  and  5.4,  we  will 
investigate  quantitatively  the  ergodicity  of  multichannel  AR  processes. 

Table  4.7.2  contains  the  parameters  used  to  specify  the  Gaussian  auto-  and 
cross-correlation  shaping  functions  described  in  eqs(4.3.7)  and  (4.3.6), 

respectively.  These  in  turn  are  used  in  the  correlation  matrix  of  the  multichannel 
Yule-Walker  equation  to  solve  for  the  matrix  [If]u  and  A(k)  k  =  1,2.  The  matrix 

C  is  then  obtained  by  taking  the  Cholesky  decomposition  of  [If]u.  We  note  that 

these  parameters  satisfy  the  constraints  discussed  in  section  4.4.  Later,  we  will 
list  the  values  of  these  matrices  and  discuss  their  significance  later. 

Figs  4.7.9  through  4.7.12  contain  the  results  for  processes  with  high 
temporal  correlation  on  each  channel.  In  Fig  4.7.9,  =  0.9999  on  both  channels 

with  lp12l=0.95.  In  Figs  4.7.10  through  4.7.12,  =  0.95  on  both  channels, 

while  the  cross-correlation  coefficient  lp12l  ranges  from  0.99  to  0.0. 

In  Fig  4.7.9,  plots  a  and  b  show  NT=200  time  sample  observations  of  the 
synthesized  processes  for  channels  1  and  2,  respectively,  for  NR=1  realization 

(trial).  A  second  realization  is  shown  in  plots  c  and  d.  A  visual  inspection  of 

these  two  trials  reveals  the  relatively  high  degree  of  cross-correlation  between  the 
two  channels  controlled  by  lp12l=0.95.  Plots  e  and  f  show  the  corresponding 

ensemble  averaged  autocorrelation  functions  calculated  using  1 ,000  trials.  In  plot 
f,  we  note  that  the  experimentally  obtained  autocorrelation  function  evaluated  for 
lag  zero  fell  somewhat  below  the  process  variance  of  4.  The  reason  for  this  will 
be  explained  below.  An  overlay  of  six  realizations  of  the  corresponding  time- 
averaged,  biased,  autocorelation  function  for  each  channel  is  shown  in  plots  g 
and  h,  respectively.  In  these  plot  .,  10,000  time  sample  observations  were  used  to 
estimate  the  functions  over  64  lag  values.  Plots  i  and  j  show  the  temporal-  and 
ensemble-averaged  cross-correlation  functions,  respectively.  Inspection  of  plots 
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Table  4.7.2  Parameters  for  the  two-channel  synthesized  processes 


*  Examination  of  eq(4.3.6)  indicates  that  the  value  of  X12  can  b*  chosen  arbitrarily  when  Ip^W).  A  value  of  0.9S 
was  used  in  this  case. 
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Fig.  4.7.11  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 

autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 

2  2 

ensemble  averaged  cross-correlation  (10,000  realizations);  an=o22=4,  lp12l=0.5. 


Fig.  4.7.12  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time -averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 
autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (4  trials)  f.) 
ensemble  averaged  cross-correlation  (1Q,000  realizations); 

2  2 

011=022*^'  1 12=^- 


g  and  h  indicates  that  the  six  realizations  of  the  estimated  time-averaged 
autocorrelation  sequences,  each  based  on  10,000  time  observations,  vary 
considerably  from  trial-to-trial.  This  implies  that  the  error  variances  of  the 
time-averaged  autocorrelation  sequencess  are  large.  Likewise,  this  same  behavior 

is  noted  for  the  time  averaged  cross-correlation  sequence  in  plot  i.  These  results 
provide  an  indication  that,  although  NT  is  as  high  as  10,000,  ergodicity  cannot  be 

assumed  to  hold  for  this  window  sample  size;  ie.,  the  estimates  of  the  auto-  and 
cross-correlation  sequences  obtained  by  time  ..v'eraging  over  a  single  realization 
will,  in  general,  differ  considerably  from  the  ensemble  averaged  value  when  the 
temporal  correlation  coefficients  are  high. 

In  Fig  4.7.10,  the  cross-correlation  coefficient  is  increased  slightly  to  0.99 
while  the  temporal  correlation  coefficients  are  reduced  to  0.95  on  both  channels. 
In  this  figure,  we  show  the  same  plots  as  displayed  in  Fig  4.7.9.  We  note  in  plots 
a  and  b,  that  both  channel  processes  have  become  more  uncorrelated  in  time  as 
evidenced  by  their  more  rapid  temporal  fluctuation.  However,  noting  the  scale 
change  on  the  plots  a  and  b,  we  see  that  the  cross-correlation  between  the  channel 
processes  has  increased;  ie.,  both  wavefomis  are  nearly  identical.  This  high 
correlation  results  from  the  high  value  of  lp12l=0.99.  Again,  plots  e  and  f  show 

the  ensemble  averaged  autocorrelation  functions  for  each  channel.  Six 
realizations  of  the  corresponding  time-averaged  autocorrelation  sequences  shown 
in  plots  g  and  h  show  a  significant  decrease  in  the  error  variance  of  these 
functions  as  compared  to  the  previous  figure.  Likewise  the  six  realizations  of  the 
time-averaged  cross-correlation  sequence  in  plot  i  also  show  a  reduction  in  their 
error  variance. 

In  Fig  4.7.11  and  4.7.12,  the  temporal  correlation  coefficients  are  held  at 
0.95  as  in  4.7.10;  however,  the  cross-correlation  coefficient  is  reduced  to  0.5  ana 
0.0,  respectively.  In  each  of  these  figures,  plots  a  and  b  show  a  single  realization 
of  200  sample  observations.  An  overlay  of  six  corresponding  temporally- 
averaged  autocorrelation  sequences,  based  on  10,000  time  sample  observations 
each,  is  shown  in  plots  c  and  d.  Six  trials  of  the  temporal-averaged  cross¬ 
correlation  sequence  are  shown  in  plot  e,  while  the  corresponding  ensemble 
averaged  result,  based  on  10,000  realizations,  is  shown  in  plot  f.  A  visual 
comparison  of  the  temporally-averaged  autocorrelation  sequences  in  Figs  4.7.10 
g  and  h,  4.7.11  c  and  d  and  4.7.12  c  and  d  indicates  that  the  error  variance 


108 


associated  with  these  plots  appears  to  remain  constant.  Again,  we  note  that  X>1 , 
and  X22  have  remained  the  same  for  each  plot,  although  Ip^l  has  changed 

significantly  from  0.99  to  zero.  Close  examination  of  the  scale  levels  for  the 
time-averaged  cross-correlation  functions  among  these  figures  also  indicates  that 
the  error  variances  of  these  estimated  functions  has  not  changed;  ie.,  the  curves 

range  in  value  approximately  ±0.2.  Thus,  it  appears  that  the  error  variance  of 
the  autocorrelation  function  does  not  vary  as  a  function  of  lp12l.  hi  section  5.2.2, 

we  show  that  this  is  true  for  a  special  case  of  correlation  among  the  quadrature 
components  of  the  processes. 

The  cross-correlation  coefficient  is  held  at  zero  in  Figs  4.7.13  and  4.7.14, 
while  the  temporal  correlation  coefficients  are  decreased  to  0.8  and  0.4, 
respectively.  Plots  a  and  b  for  Figs  4.7.12,  4.7.13  and  4.7.14  show  the  effect  of 

the  decreasing  temporal  correlation;  ie.,  the  processes  are  becoming  more 
whitened  as  decreases.  The  resulting  autocorrelation  functions  shown  in  plots 

c  and  d  for  these  cases  also  reflect  *’  '  trend  by  approaching  a  delta  function  as 
Xjj  decreases.  Close  examination  o*  .  e  in  each  of  these  figures  provides  some 

indication  that  the  variance  of  the  cross-correlation  function  decreases  as  Xn  and 

X22  decrease. 

In  Figs  4.7.15  through  4.7.20,  similar  plots  are  shown.  Fig  4.7.15  shows 
the  case  of  two  temporally  uncorrelated  processes  which  are  highly  correlated 
across  channels.  In  Fig  4.7.16,  the  temporal  cross-correlation  coefficient  X12  is 

raised  to  0.97.  The  value  of  !p12l  was  lowered  to  0.3  in  order  to  satisfy  the 

positive  semi-definiteness  constraint  condition.  In  the  expanded  view  of  the 
cross-correlation  function  displayed  in  Fig  4.7. 16f,  we  note  that  the  resulting 
estimated  values  at  these  lags  remain  high  out  to  the  lag  value  of  2.  Beyond  1=2, 
however,  the  cross-correlation  function  drops  significantly.  This  result  will  be 
discussed  later.  Fig  4.7.18  shows  the  interesting  result  obtained  when  the 
temporally  uncorrelated  signal  on  channel  2  is  required  to  be  correlated  with  the 
high  temporally  correlated  channel  1  process.  Fig  4.7.2.18c  shows  an  overlay  of 
the  two  sample  functions  shown  in  plots  a  and  b.  As  this  figure  indicates,  the 
noisy  channel  2  process  appears  as  a  modulation  on  the  channel  1  process.  It  is 
also  noted  that  the  autocorrelation  functions  for  each  channel  have  maxima  and 
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Fig.  4.7.13  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 
autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations);  Xn*X22*0.8,  lp12l»0, 
2  2 
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Fig.  4.7.14  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 
autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations);  Xj^A^OA  IPi2*s0> 

2  2 
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Fig.  4.7.16  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 
autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (64  lags-6  trials) 

f.)  time-averaged  cross-correlation  (6  lags-6  trials);  Xu*X22a0  •1*  A.J2  »0.97, 

on*a^*4,  lp12M).3,  ll2»0. 


Fig.  4.7.17  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel  2 
autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (64  lags-6  trials) 
f.)  time-averaged  cross-correlation  (6  lags-6  trials);  XU=X22»0.1,  X12=0.2, 

lp12l«0.1,  On **022*4.  Ii2*0- 


Fig.  4.7.20  Two  channel  AR(4)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-  averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-  correlation  (64  lags-6  trials) 
f.)  time-averaged  cross-correlation  (8  lags-6triais);  Xn=0.95,  X22s0.l,  X12=0.97, 

Ip  121=0.3 ,  c u=4,o22=1,  Ii2=4- 
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minima  which  occur  at  the  same  lag  values.  In  addition,  an  interesting  peak 

occurs  at  the  third  lag  value  in  plot  e.  We  will  consider  this  later. 

Finally,  we  consider  the  results  shown  in  Figs  4.7.19  and  4.7.20,  where  l12 

is  specified  to  be  4.  In  these  figures,  we  synthesize  AR(2)  and  AR(4)  processes, 
respectively.  Plots  a  and  b  in  each  figure  show  200  samples  of  the  processes.  As 
in  the  previous  case,  the  difference  in  temporal  correlation  on  each  channel  is 
noted.  The  overlay  in  Fig  4.7.19c  shows  the  effect  of  the  distinct  variances  on 
each  channel  as  well  as  the  moderate  amount  of  cross-correlation.  Six 
realizations  of  the  corresponding  autocorrelation  functions  are  shown  in  plots  d 
and  e  for  Fig.  4.7.19  and  plots  c  and  d  for  Fig  4.7.20.  The  cross-correlation 
functions  (six  realizations)  are  displayed  in  the  last  two  plots  in  each  figure  for  64 
and  8  lag  values,  respectively.  We  note  that  in  Fig  4.7. 19g,  the  cross-correlation 
function  peaks  at  a  lag  value  of  ll2=2  rather  than  l12“4.  Thus,  the  two  channels  of 

the  AR(2)  process,  which  is  a  function  of  its  previous  two  samples,  cannot  be 
delayed  with  respect  to  each  other  by  more  than  two  lag  values.  In  Fig  4.7. 20f, 

however,  we  note  tint  for  the  AR(4)  process,  the  cross-correlation  function  does 
peak  at  l12=4.  We  a.so  mention  that  in  the  case  of  the  AR(4)  process  described 

in  Fig  4.7.20,  the  parameter  lp12l  had  to  be  lowered  to  the  value  of  0.3.  This  was 

necessary  to  maintain  the  positive  semi-definiteness  requirement.  Finally,  in  plots 
c  and  d  for  Fig  4.7.20,  we  again  note  that  the  maxima  and  minima  occur  at  the 
same  lag  values.  In  addition,  we  note  that  for  this  AR(4)  process,  the  peak  values 
of  the  channel  2  autocorrelation  function  follow  the  shape  of  the  channel  1 
autocorrelation  function.  The  rapid  decrease  in  this  function  between  the  peak 
values  is  a  measure  of  the  'noisy'  channel  2  process.  The  periodic  peak  values, 
however,  are  a  measure  of  the  correlation  on  this  channel  resulting  from  its 
moderate  degree  of  cross-correlation  (ie.,  Ip12l=0.3)  with  the  high  temporally 

correlated  channel  1  process. 

Considerable  insight  into  the  process  generation  scheme  can  be  obtained  by 
examining  the  coefficients  in  Table  4.7.3  which  were  determined  from  a  solution 
of  the  Yule-Walker  equation.  For  processes  corresponding  to  Fig  4.7.9,  we  first 
note  that  the  white  noise  driving  covariance  matrix  C  has  very  low  values 
compared  to  those  in  the  A(l)  and  A(2)  matrices.  This  will  cause  the  resulting 
processes  to  be  highly  dependent  upon  the  past  data  samples  with  minimal 
dependence  upon  the  driving  white  noise  vector.  This  increases  the  temporal 
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Table  4.7.3  Coefficients  used  in  the  AR  Equation  for  the  Multichannel  Cases  of 
Section  4.7.2. 
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correlation  on  the  channel  processes.  In  addition,  the  cn  and  c21  elements  of  this 
matrix  are  approximately  equal,  while  c22  is  much  smaller.  This  will  cause  the 

elements  of  the  vector  u(n)  in  eq(4.5.4)  to  be  nearly  identical,  thus  contributing 
to  the  high  cross-correlation.  We  again  point  out  that  in  this  case  of  high 
temporal  correlation,  the  C  matrix  has  small  values.  This  will  cause  the  variance 
of  the  white  noise  driving  term  to  be  small.  If  the  overall  variance  of  the  process 
is  required  to  be  large,  the  synthesis  process  must  be  operated  over  a  long  initial 
transient  period  to  allow  the  processes  to  reach  the  specified  variance  level.  For 
this  case,  2,000  samples  were  generated  in  the  transient  period  and  discarded 
before  collecting  data.  This  quantity  was  not  sufficient  to  achieve  the  specified 
variance  level  and  thus,  slightly  low  values  of  the  ensemble-averaged 

autocorrelation  sequence  resulted  as  shown  in  Fig.  4.7 .9f. 

For  processes  corresponding  to  those  shown  in  Fig.  4.7.10,  the  cu  and  c21 
elements  are  again  nearly  equal  and  much  greater  than  c22  so  that  the  very  high 

cross-correlation  is  obtained.  We  note,  however,  that  all  the  C  matrix  elements 
have  increased  as  compared  to  the  previous  case.  This  will  cause  the  additive 
white  noise  driving  variance  to  have  a  more  significant  effect  on  the  resulting 
process.  As  a  result,  tenr  ral  correlation  on  each  channel  will  decrease  as 
expected  since  the  A.j  l  and  values  have  been  decreased. 

For  processes  corresponding  to  Fig.  4.7.12,  we  note  that  only  cn  and  c22 

are  non-zero.  This  will  cause  the  vector  u.(n)  to  have  totally  uncorrelated 
elements,  thus  providing  no  cross-correlation  as  required  since  lp12l=0. 

Examination  of  these  elements  for  processes  corresponding  to  Figs.  4.7.12 
through  4.7.16  shows  the  increasing  significance  of  the  white  noise  driving  term 
relative  to  the  past  values;  ie.,  the  C  matrix  eventually  begins  to  weight  the  white 
noise  vector  y.(n)  higher  than  the  A(k)  k=l,2  matrices  weight  the  past  samples. 
Thus,  the  temporal  correlation  decreases. 

For  the  matrix  elements  corresponding  to  the  Fig.  4.7.16  results,  we  make 
the  following  observations.  First,  the  relatively  high  values  of  the  C  matrix 
elements  compared  to  the  A(k)  matrices  again  provides  emphasis  on  the  white 
noise  driving  term.  Second,  the  relatively  high  and  equal  off-diagonal  elements 

of  the  two  A(k)  matrices  provides  high  cross-correlation  with  respect  to  the  two 
past  sample  values.  This  result  is  controlled  by  the  high  value  of  A.12=0.97. 

Third,  the  value  lp12l=0.3  has  a  significant  effect  on  the  c21  element.  It  is  close  to 
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the  maximum  value  for  the  cross -correlation  coefficient  that  can  be  obtained 
under  the  constraint  condition  of  positive  semi-definiteness.  The  result  is  that  the 
white  noise  vector  is  provided  a  moderately  high  cross-correlation.  This  case  can 
be  contrasted  with  the  coefficients  for  Fig  4.7.17.  In  this  case,  the  low  value  of 
X12=0.2  and  Ip  ^1=0.1  causes  the  off-diagonal  elements  in  the  A(k)  matrices  and 

the  c21  to  decrease  significantly. 

In  this  chapter,  we  have  developed  a  time  series  methodology  for  the 
synthesis  of  multichannel  autoregressive  (AR)  processes.  The  multichannel 
synthesis  procedure  provides  a  capability  for  the  generation  of  processes  with 
variable  temporal  and  cross-channel  correlation  properties  as  well  as  signal-to- 
noise  ratios.  In  addition,  this  method  was  generalized  to  provide  a  capability  for 
generating  AR  processes  in  which  we  are  able  to  control  not  only  the  temporal 
and  cross-channel  correlation,  but  also  the  correlation  between  quadrature 
components.  The  method  allows  one  to  specify  these  correlation  properties 
directly  in  the  correlation  matrix  of  the  concatenated  quadrature  form  of  the 
Yule- Walker  equations  presented  in  eq(4.6.6)  and  to  synthesize  the  more  general 
processes  discussed  in  Appendix  N.  Finally,  specific  examples  of  synthesized 
scaler  and  vector  processes  are  shown  to  illustrate  the  capability. 
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CHAPTER  5  ERGODICITY  CONSIDERATIONS 


5.1  INTRODUCTION 

Ergodicity  is  the  condition  which  enables  time-averaged  statistics  of 
random  processes  to  approximate  those  obtained  by  ensemble  averages.  This 
condition  is  often  assumed  in  estimation  and  other  signal  processing  applications. 
The  ergodicity  condition  for  auto-  and  cross-channel  correlation  functions 
expressed  in  terms  of  fundamental  process  parameters  is  derived  in  this 
dissertation.  Specifically,  analytic  expressions  are  developed  for  the  variance  of 
the  biased,  time-averaged  correlation  functions  for  stationary  discrete  complex 
processes.  These  expressions  relate  the  variance  to  the  correlation  functions  of 
the  underlying  processes  as  well  as  the  size  of  the  observation  window.  When  the 
variance  is  suitably  small,  the  ergodic  condition  is  said  to  hold;  ie.,  a  time- 
average  closely  approximates  the  corresponding  ensemble  average.  The  analytic 
expressions  for  the  variance  provide  a  performance  measure  which  can  be  used  to 
specify  the  window  size  of  the  observation  interval  required  to  achieve  a  specific 
value  of  this  variance.  In  this  section,  the  functional  forms  of  the  correlation 
shaping  functions  described  in  section  4.3  are  used  to  relate  these  variances  to  the 
process  temporal  and  ensemble  correlation  parameters.  A  unique  aspect  of  this 
development  is  the  de.  .mination  of  the  functional  dependence  of  these 
expressions  in  terms  of  the  process  temporal  and  ensemble  correlations.  As  a 
result,  the  analytic  expressions  provide  a  measure  for  the  variance  of  the  time- 
averaged  correlation  functions  in  terms  of  both  the  window  of  the  sample 
integration  size  and  these  fundamental  process  parameters.  As  an  example,  the 
increase  in  sample  size  required  to  achieve  a  specific  value  of  the  variance  of  the 
time-averaged  correlation  functions  is  quantitatively  related  to  the  increase  in 
temporal  correlation  as  well  as  the  variance  of  the  underlying  process.  In 
addition,  the  analytic  expressions  are  simplified  for  the  general  case  of  Gaussian 
processes  with  unconstrained  quadrature  components  where  the  usual  constraints 
associated  with  a  complex  Gaussian  process  are  relaxed.  Validity  of  the  analytic 
expressions  is  presented  using  the  multichannel  process  synthesis  method 
described  in  chapter  4.0. 
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5.2.  VARIANCE  OF  THE  TIME-AVERAGED  CORRELATION 
FUNCTIONS 

5.2.1  Variance  of  the  Time-Averaged  Autocorrelation  Function 

The  ensemble  autocorrelation  function  is  defined  as  the  expectation  of 


lagged  products  of  a  given  stationary  process  when  averaged  over  an  ensemble  of 
realizations.  If  this  function  is  equal  to  the  time-averaged  autocorrelation  function 
obtained  from  a  single  realization,  the  process  is  called  autocorrelation  ergodic. 
Consider  the  time-averaged  estimate  of  the  autocorrelation  function  using  NT 

observation  samples 

"  nt-h 

i  x  xi(n)x*(n-l)  0  <  1  <N  -1 

M  n=0 

<W'Nt)  - < 

77  £  xi(n)xi(n-lll)  -(N  -1)  <1  <0. 
n=0 

(5.2.1) 

For  M  =  Nx,  we  obtain  the  biasedt  estimator  RiiTb(l,NT)  while  for  M=NT-I, 

we  have  the  unbiased  estimator  (I.NT)  131.  We  now  define 

*ub 

<|>(n,l)  =  xj(n)x*(n  - 1) 

(5.2.2a) 

and 

Et4>(n,l)4>  *  fn  -  k.l)] 

(5.2.2b) 

so  that 

cw(k,l)  =  E[  ( <Hn,0  -  E[<t>(n,l)J )  {«Vk,l)  -  E[<t>*(n-k.i>] )  ] 

(5.2.2c) 

t  In  (his  dissertation,  we  primarily  consider  the  biased  estimator  for  (he  correlation  functions  with  limited  data  since 
it  ensures  positive  semi-definiteness.  In  [3],  an  estimator  with  unlimited  data  is  also  considered. 
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R^(k,l)  -  E[$(n,l)]E[$*(n-k,l)]. 


(5.2.2d) 


Using  eq(5.2.1),  the  variance  of  fti£T^(l,NT)  can  now  be  expressed  as  (see 
Appendix  D) 


VB|j(I.Nt>  = 

=  E  { [6iiT(l,Nx)  -  (l,NT)  )][C(I,N,)  -  E(C(I,Nt)  } 

o  b  b  b 

=  E[ftjiT  (l,NT)ft^  (l,NT)]  -  EtfejiT  ('.Nt)] 

Jb  b  *b  b 


NT-ll|.l 

I 

k-(NT-ll|-l) 


lll+lkl 

Nt 


(5.2.3a) 

(5.2.3b) 


(5.2.3c) 


In  Appendices  E  through  G,  it  is  shown  for  the  general  case  of  Gaussian 
processes  with  zero-mean  and  unconstrained  quadrature  components  that 

Vb..(!,Nt)  «  ;t-  £  [l  -  "J#1!  [lRH(k)l2  +  Re{Fjj(l,k))l  (5.2.4) 

t  k— (Nx-ll|-l)  l  J 

where 

R^OO  *  E^n^  (n  -  k)]  (5.2.5a) 

and 

Fu(U)  *  E^OOxiOi  - 1  -  k)]E[x*(n  -  l)x*(n  -  k)].  (5.2.5b) 

Using  eq(E.6)  in  Appendix  E,  it  can  be  shown  in  the  special  case  where 

Ru(l) «  Rjftl)  (5.2.6a) 


and 


Ru'd)  -  •  R|f(l) 


(5.2.6b) 


Re{Fii(l,k)}=0 


for  all  l,k. 


In  this  case,  eq(5.2.4)  becomes 


N--HI-1 


Vbu('.nt)  =  if  2  f1 '  "W\  lRu«|2- 

a  T  k— (Nx-ll|-l)  1  T  J 


(5.2.7) 


(5.2.8) 


5.2.2.  Variance  of  the  Time-Averaged  Cross-Correlation  Function 

For  the  ensemble  cross-correlation  function,  lagged  products  between  two 
processes  are  averaged  over  an  ensemble  of  realizations.  Let  the  lagged  product 
between  the  wide-sense  jointly  stationary  processes  jq(n)  and  Xj(n)  be  denoted  by 

P(n,l)  =  xA(n)  Xj  (n  - 1).  (5.2.9) 

The  autocorrelation  function  for  P(n,l)  is  expressed  as 

Rpp(k,l)  *  E[P(n,l)P*(n  -  k,l)].  (5.2.10) 


From  eq(5.2.9) 

E[p(n,l)]  =  Rjj(l)  (5.2.11a) 

E[p*(n  -  k,l)]  =  Rjj(l).  (5.2.11b) 


Using  the  same  form  as  eq(5.2.2c) 

Cp|j(k,l)  =  Rp(J(k,l)  -  E[P(n,l)]  E[P*(n  -  k,l)]  (5.2.12a) 

=  Rpp(k,l)  -  lRy(l)lJ.  (5.2.12b) 

The  variance  of  the  time-averaged  cross-correlation  function  is  therefore 
expressed  as 
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VBlj(l,NT)  = 


i_  V  fi  HhMln 

NT  MNt-II|-1)  l  Nt  j  pp 


Using  eq(5.2.12b)  in  (5.2.13),  we  have 


(5.2.13) 


N..III-1 


VBi.(I,Nt)  -  =5-  £  [l  -  "-^l  [RpaOc.1)  -  lRij(l)l2].  (5.2.14) 

Tk*-(NT-ll|-l)  L  TJ 


We  now  consider 


Rpp(k,l)  =  E[|3(n,l)p*(n  -  k,l)] 

=  E[Xi(n)Xj(n  -  l)xi(n  -  k'xj(n  - 1  -  k)] 

so  that  eq(5. 2. 14)  becomes 

v  /IN,  i  Nv!M  r.  iH±ikn 

VBijW  =  Nl  I  |1-  T*TJ* 

1  *  k=-(N.j.-ll|-l)  L  T  J 

{E[xi(n)xj(n  -  l)xj(n  -  k)xj(n  - 1  -  k))  -  lRjj(l)l2]} . 


(5.2.15a) 

(5.2.15b) 


(5.2.16) 


For  Gaussian  processes  with  zero-mean  and  unconstrained  quadrature 
components,  eq(5.2.15b)  can  be  expressed  as  (see  Appendix  H) 

RppOU)  *  E[xj(n)xj(n  -  l)]E[xi(n  -  k)xj(n  - 1  -  k)] 

+  E[X|(n)x[(n  -  k)]E[xJ(n  -  l)xj(n  - 1  -  k)J 


+  E[xj(n)xj(n  - 1  -  k)]E(xj(n  -  l)xj(n  -  k)J 
=  Rij(l)RijO)  +  Rii(k)Rjj(k)  +  Fjj(l,k) 


(5.2.17a) 

(5.2.17b) 
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(5.2.17c) 


=  iRijd)!2  +  Rj|(k)Rjj(k)  +  Fy(l,k) 

where 

Fij(Mc)  =  E[Xi(n)Xj(n  - 1  -  k)]E[x*(n  -  l)xj(n  -  k)].  (5.2.18) 

Using  eq(5.2.17c)  in  (5.2.14),  we  obtain 

VBii(I,Nt)  =  fT-  X  [l  -  '^1  [Rji(k)Rjj(k)  +  Fjj(l,k)|.  (5.2.19) 

T  k— (Nt-II|-1)  l  t  j 


In  Appendix  H,  we  show  that  the  summation  in  eq(5.2.19)  over  positive 

* 

and  negative  values  cancels  the  imaginary  terms  in  Rjj(k)Rjj(k)  and  Fy(l,k),  so 


N-j—lll- 1 


vBii(''NT)  =  N  S  1  •  RetRa(k)R^(k)  +  Fij(l,k)].  (5.2.20) 
T  k=  (Nrlll-l)  L  T  J 


We  note  that  the  term  Re[Fjj(l,k)]  will  contribute  a  dependence  of 
VBy(I.NT)  upon  cross  correlation  parameters  such  as  the  cross-correlation 
coefficient  Ipyl  defined  in  section  4.3.  From  eqs(5.2.6),  where  the  subscript  ii  is 
replaced  by  ij,  Rjj(l)  =  Ry^(l)  and  Rjj*(l)  =  -  Ry!(l).  In  Appendix  O,  we  show  that 

these  conditions  hold  when  the  bandpass  processes  are  jointly  stationary  and 
narrowband.  In  Appendix  H,  we  also  show  that  in  this  case  Fjj(l,k)=0  and, 

therefore,  eq(5.2.9)  reduces  to 


Nrlll-1 


VBij(I.NT)  =  X  [l  -  "J#!lRe[Rii(k)R‘j(k)].  (5.2.21) 

T  k=-(Nrlll-l)  L  T  J 


129 


5.2.3.  Sample  Variance  of  the  Correlation  Functions 


Consider  NR  realizations  of  the  random  process  Xj(n).  Let  each  realization 
be  indexed  by  the  integer  a;  a=l,2,...,NR.  Corresponding  to  the  realization  with 

index  a,  let  ^ijTb(l*NT|a)  be  the  biased,  time-averaged  cross-correlation  function 

estimate  using  NT  observation  samples.  The  sample  variance  of  the  time-averaged 
cross-correlation  function  estimate  is  computed  from  NR  realizations  using  the 
expression 


Nr 

Var[ftijTb(l,NT):NR]  =  ^  £  I  £ijTb(I.NTja)  -  ft,jTb(l,NRla)  I2  (5.2.22) 

R  a-1 


where 


nr 

&ijTb0*NRla)  =  £  $ijTb(l,NT|a). 


R  a=l 


(5.2.23) 


The  above  results  reduce  to  the  sample  variance  of  the  time-averaged 
autocorrelation  function  when  i=j. 

5.2.4.  Discussion 

In  section  4.3,  we  presented  functional  forms  for  the  auto-  and  cross- 
correlation  functions  in  terms  of  the  process  parameters.  For  example,  an 
exponentially  shaped  autocorrelation  function  with  positive  magnitude  can  be 
expressed  as 

Rj,(k)  =  (Xii)lkl  exp(j0jj(l)].  (5.2.24) 


where  0,1  is  the  variance  of  the  channel  i  process,  is  a  temporal  correlation 

coefficient  which  is  a  measure  of  the  correlation  magnitude  between  consecutive 
samples  such  that  0<X^<1,  and  0jj(l)  is  the  phase  of  the  correlation  function. 

Using  eq(5.2.24)  in  eqs(5.2.8)  and  (5.2.21),  we  obtain 
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(5.2.25) 


vBu(i.nt)  =  g-  X  [  i  -  "ijr]  °u  (h>1M 

u  ‘  T  k=-(Nrlll-l)  L  T  J 


Nrlll-1 


v  JL  V  Ti  4i±M|2.  Jkl  2  .  „ 

VBuO.NT)  -  m  L  M  "  Nt  °jj  (^22) 

T  k=-(Nrlll-l)  L  T  J 

costf^l)  -  0jj(l)]. 


(5.2.26) 


We  note  in  the  special  case  described  by  the  contraints  Rij(l)  =  RyQ(l)  and 
Rif(l)  =  -Ry^l),  that  VBj.(l,NT)  is  independent  of  Ip^l.  When  invoking  the 

ergodic  assumption,  one  would  like  the  variances  in  eqs(5.2.25)  and  (5.2.26)  to 
be  suitably  small  so  that  the  time-averaged  correlation  function  is  a  satisfactory 

approximation  to  the  ensemble  correlation  function.  For  a  given  Xy  and  <jy,  these 

analytic  expressions  provide  a  means  for  determining  the  value  of  NT  required  to 
reduce  the  variance  to  a  specified  level.  A  unique  aspect  of  this  development  is 

the  determination  of  these  expressions  in  terms  of  both  the  observation  window 

2 

size  and  the  process  parameters  ay  and  Xy.  These  expressions  indicate  for  Xy<l, 

that  their  limit  approaches  zero  as  NT  approaches  infinity.  Thus,  for  stationary 

processes,  ergodicity  holds  in  all  cases  except  for  total  temporal  correlation  (ie., 

2 

Xy=l).  However,  as  a, *  and  Xy  change,  these  equations  provide  a  quantitative 

measure  expressing  the  requirements  on  the  observation  window  to  obtain  time- 
averaged  correlation  function  estimates  which  yield  a  close  approximation  to  the 
ensemble  averaged  correlation  functions. 
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5.3.  RESULTS 


5.3.1.  Computed  Variance  of  the  Time-Averaged  Autocorrelation 
Function 

In  this  section,  we  validate  eq(5.25)  for  the  exponential  autocorrelation 
function  of  eq(5.2.24).  Consider  a  real  AR(1)  process  for  which  the 
autocorrelation  function  can  be  shown  to  be 

RarOO  =  RarW  t-a(l)]'“ 

=  <4  [-a(l)]lkl 

where 

2 

0u  2 

Rar(0)  =  i'— a2(fj  =  4  (5.3.2) 

2  2 

and  ou,  a(l)  and  are  the  white  noise  driving  variance,  the  AR(1)  parameter, 

and  the  variance  of  the  AR(1)  process,  respectively.  To  be  consistent  with  the 

AR(1)  process  used  in  this  example,  the  constants  in  eq(5.2.24)  were  chosen  to  be 
2  2 

^ij--a(l),  ^ii-^AR  and  0jj(l)=O  for  all  I.  Table  5.3.1  contains  the  parameters  used 

2 

in  the  process  synthesis  procedure.  The  variance  <jjj  was  held  fixed  at  4  while 
was  varied  using  0.1,  0.7  and  0.99. 


Fig. 

2 

Nt 

Nr 

5.3.1 

4 

0.1 

100 

10,000 

5.3.2 

4 

0.7 

100 

10,000 

5.3.3 

4 

0.99 

100 

10,000 

Table  5.3.1  Parameters  used  in  the  single  channel  process  synthesis  procedure. 


(5.3.1a) 

(5.3.1b) 
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Figs  5.3.1  through  5.3.3  show  the  autocorrelation  functions  and  their 
variances.  In  plot  a,  we  show  six  realizations  of  the  biased,  time-averaged 
autocorrelation  function  plotted  over  64  lag  values  using  NT=100  time  samples. 
The  corresponding  ensemble  averaged  result  is  shown  in  plot  b  using  NR= 10,000. 

The  sample  variance  Var[ftiiTk(l,NT):NR]  of  the  biased  time-averaged 

autocorrelation  function  computed  using  eq(5.2.22)  with  NR= 10,000  is  displayed 
in  c.  The  corresponding  analytic  calculation  of  VB..(I,NT)  using  eq(5.2.25)  is 

shown  in  plot  d.  The  decrease  in  this  quantity  as  a  function  of  I  is  a  result  of  the 
weighting  associated  with  the  biased  estimator.  In  plot  e  of  Fig.  5.3.1,  we  show 
the  corresponding  sample  variance  using  the  unbiased  estimate  of  the 
autocorrelation  function  [ie.,  eq(5.2.1)  with  M=NT-I  ]  and  note  the  increase  in  this 

quantity  as  a  function  of  I.  A  similar  behavior  is  noted  in  Fig  5.12  of  Ref  [37]  for 
continuous-time  processes.  The  computed  results  are  in  excellent  agreement  with 
the  analytic  expressions  (note  the  scale  change  between  plots  c  and  d  in  Fig  5.3.1). 
In  Fig  5.3.4,  the  maximum  value  of  VB..(I,NT)  which  occurs  at  1=0  is 

plotted  (solid  curve)  as  a  function  of  Xjj  for  NT=100  and  NT=1000  using  the 

analytic  expression  of  eq(5.2.25).  The  corresponding  sample  variances  of  the 
time-averaged  autocorrelation  function  estimates  computed  at  lag  zero  using 
eq(5.2.22)  with  i=j  for  the  synthesized  data  processes  are  also  plotted  (•)  on  this 
curve.  These  values  were  computed  using  NR  realizations  of  the  functions.  For 
Nt  =100,  NR= 10,000  was  used  while  for  NT  =1000,  the  number  of  realizations 
was  reduced  to  NR= 1,000.  Reducing  NR  decreases  the  confidence  level  associated 

with  the  computation  of  the  sample  variance  Var[ftjjTb(l,NT):NR].  However,  the 

error  bars  representing  one  standard  deviation  from  the  mean  are  less  than  the 
size  of  the  printed  (•).  The  results  shown  in  this  figure  indicate  the  significant 
increase  in  the  variance  VB..(I,NT)  as  a  function  of  In  addition,  it  provides  a 

measure  of  the  required  observation  window  size  necessary  to  achieve  a  specific 
level  of  the  variance.  For  example,  the  curve  for  N^IOOO  has  a  very  distinct 
knee  for  A.jj=0.9.  For  processes  with  a  temporal  correlation  above  this  value,  a 
larger  observation  data  window  would  be  required  to  reduce  VB..0,NT)  to  values 

less  than  0.2.  We  also  note  that  for  NT=100,  large  variances  can  be  obtained 
even  for  moderately  low  values  of 
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Fig.  5.3.1  Estimated  autocorrelation  function  and  its  variance  for  an  AR(1) 
process;  X=0.1,  <Js=4,  a.)  £^(1)  (6-trials)  using  N^lOO  b.)  ensemble-averaged 

ftiiE(l)  using  10,000  realizations  c.)  sample  variance  of  (I)  d.)  analytical 
variance  of  £^(1)  e.)  sample  variance  of  the  unbiased  (I). 


Fig.  5.3.2  Estimated  autocorrelation  function  and  its  variance  for  an  AR(1) 
process;  X=0.7,  a*  =4,  a.)  (6-trials)  using  N-^100  b.)  ensemble-averaged 

(I)  using  10,000  realizations  c.)  sample  variance  of  ft,,  (I)  d.)  analytical 

E  Tb 

variance  of  (I). 

uTb 


5.3.2.  Computed  Variance  of  the  Time-Averaged  Cross-Correlation 
Function 

We  now  consider  the  case  of  a  two  channel  AR(1)  process  with  real 
correlation  junctions.  Table  5.3.2  contains  the  parameters  used  in  the  process 
synthesis  procedure  described  in  section  4.5  to  specify  the  correlation  functions 

of  the  Yule- Walker  equation.  This  equation  is  then  solved  for  the  matrices  A(l) 
and  [If]u.  Table  5.3.3  lists  the  AR  coefficient  matrix  A(l)  and  the  Cholesky 

matrix  C  obtained  by  the  Cholesky  decomposition  of  [£f]u.  We  note  in  each  of 
the  A(l)  matrices  that  we  maintain  the  conditions 


*aU  =  X11 

(5.3.4a) 

'a22  =  ^22 

(5.3.4b) 

II 

II 

© 

(5.3.4c) 

We  also  note  that  the  cross-correlation  between  the  process  is  controlled  by 
the  elements  of  the  C  matrices;  ie.,  for  high  correlation,  the  cn  and  c21  elements 

become  nearly  equal  while  c22  diminishes.  For  low  correlation,  the  c21  element 

2  2 

diminishes.  In  these  cases,  the  variance  of  the  processes  an  and  a22  was  held 

fixed  at  4  while  Xn  and  X,22  had  values  of  0.1,  0.5  and  0.9.  The  cross- 
correlation  coefficient  Ip  12l  had  values  of  0.99,  0.5  and  0.0.  For  the  special  case 
where  Fjj(l,k)=0  [see  discussion  leading  to  eq(5.2.21)],  the  results  are  independent 
of  the  correlation  coefficient  lp12l. 

Figs  5.3.5  through  5.3.9  show  the  results  for  these  variances  based  on  the 
computed  values  of  eq(5.2.22)  and  the  analytic  expression  of  eq(5.2.26).  The 

computed  results  are  in  excellent  agreement  with  the  analytic  expressions.  In  Fig 
5.3.10,  the  maximum  value  of  VB  (l,NT)  which  occurs  at  1=0  is  plotted  (solid 

curves)  as  a  function  of  tk=\n=’k2i  f°r  NT  =  100  and  NT  =  1000  using  the  analytic 

2  2 

expression  of  eq(5.2.26)  and  on=  o22=4.  The  corresponding  maximum  values  of 

the  sample  variances  of  the  time-averaged  cross-correlation  function  estimates 
computed  using  the  synthesized  data  processes  are  also  plotted  (•)  on  this  curve. 
These  values  were  computed  using  NR=  1000  realizations  of  the  functions.  In 
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Fig. 

2 

<*11 

2 

<*22 

*il 

X22 

X12 

'P.21 

nt 

Nr 

*12 

5.3.5 

4 

4 

0.1 

0.1 

0.1 

0.99 

100 

0 

5.3.6 

4 

4 

0.1 

0.1 

0.1 

0.5 

100 

n 

4 

4 

0.1 

0.1 

0.1 

0.0 

100 

1000 

0 

5.3.8 

4 

4 

0.5 

0.5 

0.5 

0.5 

100 

1000 

0 

5.3.9 

4 

4 

0.9 

0.9 

0.9 

0.5 

100 

1000 

0 

Table  5.3.2  Parameters  used  in  the  two-channel  AR(1)  synthesis  procedure 


Figure 

_ Ml) _ 

c 

5.3.5 

■SSH 

5.3.6 

IH 

iWi 

HiH 

H 

5.3.7 

Hi 

IH 

H 

i— 

H 

5.3.8 

BHi 

H 

H 

5.3.9 

HI 

mm 

H 

H 

Table  5.3.3  Matrices  A(l)  and  C  used  in  the  two-channel  synthesis  procedure. 


Fig.  5.3.5  Estimated  cross -correlation  function  and  its  variance  for  an  AR(1) 
process;  lpi2l*0.99,  l^s'O  a.)  £^(1)  (6-trials)  using 

Nf=100  b.)  ensemble-averaged  ^ij£(l)  (1,000  realizations)  c.)  sample  variance  of 

(I)  d.)  analytical  variance  of  fL  (I). 


SAMPLE 


ANALYTICAL 


EUHHH 

■■■■HI 


Fig.  5.3.6  Estimated  cross-correlation  function  and  its  variance  for  an  AR(1) 
process;  X11=X22=^i2ss0-l.  lp12i=0.5,  l12=0  a.)  ft^O)  (6-trials)  using 

Nf=100  b.)  ensemble-averaged  ftjjE(l)  (1,000  realizations)  c.)  sample  variance  of 

ft;;  (I)  d.)  analytical  variance  of  ft;;  (I). 


a  b 


c  d 

Fig.  5.3.8  Estimated  cross-correlation  function  and  its  variance  for  an  AR(1) 
process;  Xn=X22=X12*0.5,  0**4,  lp12M).5,  l12=0  a.)  (6-trials)  using 

NfslOO  b.)  ensemble-averaged  fty^l)  (1,000  realizations)  c.)  sample  variance  of 

ftij^O)  d.)  analytical  variance  of  ^ijTl>(*)- 
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Fig.  5.3.10  Maximum  variance  of  the  time-averaged  cross-correlation  function 

2  2 

■srsus  XsA.ijsA.22  for  c^s  022=4;  analytical(-)  and  computed  (•). 


several  of  the  figures,  we  note  the  increase  in  the  sample  variance  of  the  cross- 
correlation  functions  Var[ftjjT  (l,NT):NR]  over  that  of  the  autocorrelation 

functions  Var[ftyTb(l,NT):NR]  presented  in  the  previous  section.  This  is  due  to  the 
decrease  in  NR  from  10, OCX)  to  1,000. 
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CHAPTER  6.  MULTICHANNEL  LIKELIHOOD  RATIO 


6.1.  DERIVATION 

In  this  section,  we  develop  a  multichannel  likelihood  ratio  for  the  detection 
problem  of  eqs(3.1.1);  ie., 

Ht:  a(n)  =  a(n)  +  £(n)  +  ^(n)  n  =  1,2,...,N  (6.1.1a) 

H0:  i(n)  =  £(n)  +  a(n)  n  =  1,2,...,N  (6.1.1b) 


where  each  of  the  complex  vectors  are  Gaussian,  Jxl  vectors  and  i(n)  is  the 

baseband  observation  vector.  The  methodology  derived  here  stems  from  the 
considerations  presented  in  [1]  for  real  processes.  Under  hypothesis  Hj,  the 

multivariate  joint  Gaussian  density  can  be  written  as  the  product  of  conditional 
densities  so  that 


N 


Px(ii.NIHi) =  pU(l)|Hi]  ptifajlii  ^n- 1  .Hj] 


where 


=  UT(1)  *T(2)...iT(n)] 
xT(k)  =  (xj(k)  x2(k)...Xj(k)] 

au=i(i) 


i=0,l 


(6.1.2) 


(6.1.3) 

(6.1.4) 

(6.1.5) 


and  all  the  conditional  densities  are  Gaussian.  The  mean  of  the  multivariate 
conditional  density  p[&(n)la,n.j,Hj]  is  &(nln-l,Hj);  ie.  the  linear  MMSE  predictor 
of  a(n)  using  past  data  a1  n.j  when  Hj  is  true  [44].  The  JxJ  covariance  matrix  of 
this  density  function  is  the  conditional  covariance  matrix  Kx(nln-l,Hj)  such  that 

Kx(nln-i,Hj)  =  E{[*(n)  -  £(nln-l,Hj)][*(n)  -  £(nln-l,Hj)]H]  (6.1.6a) 

=  E[£(nlHj)£H(nlHj)]  n  =  1,2,. ..,N  i  =  0,1  (6.1.6b) 


where 
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5r*S‘ *  ■  -SiVPEa^r ' 


£(nlHj)  =  i(n)  -  £(nln-l,Hj)  i  =  0,1  (6.1.7) 

is  a  zero-mean  MMSE  vector.  In  eq(2.4.1d),  we  defined  the  linear  estimator 
&(nln-l,Hj)  based  on  p  past  data  samples.  Assuming  wide-sense  joint  stationarity 

on  the  narrowband  bandpass  processes,  the  conditional  density  functions  can  be 
expressed  in  terms  of  a  quadratic  form*  such  that 

p[&(n)l&lfn_1,Hi]  = 

=  (jc)J|Kx(nln- 1  ,Hj)lexp ^ *  t^n)'^n,n'1’Hi)lHtKx(n,n’1»Hi)r1[i(n)4(nln-l,Hi)]} 

i «  0,1.  (6.1.8) 

where  the  notation  IAI  denotes  the  determinant  of  the  matrix  A  and 

i(llO,Hj)  =  a  i  =  0,1.  (6.1.9) 

Using  eq(6.1.7)  in  (6.1.8),  we  obtain 

Pk<n>,Siin-i’Hi]  * 

*  (n)J|K.(nln-1,Hi)l exp(-  6H(n'Hi)[Kx(nln-l,Hi)r16(nlHi)}  i  =  0,1  (6.1.10) 
where 

pixcdihi)  -  pteaxHi] 

°  (Wx(n0.Hi)l  expl~  £HO|Hi)[Kx(ll0,Hi)]-1£(  HHj))  i  =  0,1.  (6.1.11) 

We  can  now  express  the  likelihood  ratio  for  the  multivariate  joint  Gaussian 
density  functions  as 


*  The  condition  of  wide-sense  joint  stationarity  on  the  narrowband  hanrfnaw  processes  provides  specific  relationships 
between  the  auto-  and  cross-correlation  sequences  of  the  in-phase  and  quadrature  components.  These  relationships 
enable  the  multivariate  Gaussian  density  function  to  be  expressed  directly  in  terms  of  the  complex  random  vectors  as 
given  by  eq(6.1.8).  A  complete  discussion  of  this  topic  is  presented  in  Appendices  N  and  O. 
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Px(&lJSIHl) 

^•"o'PxQhjW 


N 


(p[x(l)IH1]I^p[i(n)li1>n.1,H1]) 


N 


(p[i(l)IHo]  FI  p[i(n)l4itn_i,H0]) 

n*2 


(6.1.12a) 


V  1.12b) 


where  the  last  equality  results  from  eq(6.1.2).  Substituting  eqs(6.1.10)  and 
(6.1.1 1)  into  (6.1.12b)  and  taking  the  natural  logarithm,  we  have 


InAti  u 


'  N 

n  IKx(nln- 1  ,Ho)l  exp  { -£H(nlH , )[Kx(nln- 1,H !)]-'£( nIH ,) ) 


IKx(nln-l,H|)l  exp  ( -£H(nlH0)[Kx(nln-l,H0)r  ‘£(nlH0) ) 

*-  n=l 


(6.1.13a) 

[  IKx(nln-l,Ho)l  . 

lnIKx(nin-lIH1)i +  £H<r'IHo)(I<x(nln-l,Ho)]‘1£  (nlH0) 

-£H(nlH1)[Kx(nln-l,H1)]'1£(nlH1)].  (6.1.13b) 


Eq  (6.1.13b)  can  be  simplified  further  by  a  diagonalization  of  the  conditional 
covariance  matrices  and  an  orthogonal  transformation  of  £(nlHj)  i=0,l  across 

channels.  Since  these  matrices  are  Hermitian  and  positive  semi-definite,  several 
decompositions  could  be  performed.  In  this  dissertation,  two  decompositions  are 
considered. 

6.1.1.  Whitening  using  an  LDLH  Decomposition 

We  first  consider  an  LDLH  decomposition  of  Kx(nln-l,Hj)  such  that 

Kx(nln-l,Hj)  =  Ly(nlHj)  D^nlHj)  L^(nlH|)  i  =  0,1  (6.1.14) 
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"V*-“  w^w  -r^  ~-  : - 


where  L^nlHj)  is  a  JxJ  lower  triangular  unit  diagonal  matrix  and  D^nlHj)  i=0,l 
is  a  JxJ  diagonal  matrix  with  real  elements  dyy(niHj).  In  the  discussion  below,  we 


note  that  Kx(nln-l,Hj)  is  a  deterministic  function  [1]  of  the  past  observation  data. 
Consequently,  Ly(nlHj)  and  D^nlHj)  are  determined  by  the  past  data.  Noting 
that  Ly(nlHj)  is  non-singular  and  solving  for  D^(nlHi),  we  have  from  eqs(6.1.14) 


and  (6.1.6b) 


D^nlHj)  =  ll1(nlHi)Kx(nln-I,Hi)[L^(nlHi)]'i  (6.1.15a) 

=  L^nlHj)  E[£(nlH|)(£H(nlHj))  [L^nlHj)]11  (6.1.15b) 

=  eIl^1  (nIHj)  £(nlHi)eH(nlHi)  (L^nlH,)]^  (6.1.1 5c) 

=  EWnlHi^nlHj))  i  =  0,l  (6.1. 15d) 

where 

y(nlHj)  =  Ly^nlHi^nlHi)  i  *  0,1.  (6.1.16) 


Since  D^nlHj)  is  a  diagonal  matrix,  eq(6.1.15d)  implies  that  y(nlHj)  contains 

uncorrelated  elements  across  the  channels.  In  Appendix  A,  it  is  shown  that 
£(nlHj)  is  a  white  noise  process.  Hence, 

EfefalHj^n'IHj)]  =  [0]  n  *n’  i  =  0,1.  (6.1.17) 

Solving  for  £(nlHi)  in  eq(6.1.16),  and  substituting  in  eq(6.1.17),  we  have 

ElLynlHj)  tfnlHjtfVlHj)  (L^n'lHj)]”]  =  [0]  (6.1.18a) 

so  that 

L/nlHi)  EbOUHj^nlHi)]  [L/n’IHi)]*1  =  [0] 

n*n’  i  =  0,1.  (6.1.18b) 


150 


Since  the  matrices  Ly(nlHj)  are  non-singular,  it  follows  that 


EltfnlHjtfVlHi)]  =  [0] 


n  n  i»  0,1. 


(6.1.19) 


In  summary, 


E[y{nlHi)yH(n,IHi))  = 


Dy(nlHj)  n=n' 
L  [  0  ]  n^n' 


is  0,1. 


(6.1.20) 


Eq(6.1.20)  indicates  that  y(nlHj)  is  uncorrelated  in  time  and  across  channels. 
From  eq(6.1.14),  we  now  have 

Kx1(nln-l,Hi)  =  [L^(nlHi)]"1Dy  (nlHj)L^1  (nlHj)  i=0,l.  (6.1.21) 


and 


H 


IKx(nln-l,Hi)l  =  !Ly(nlHi)IID7(niHi)llLy (nlHj)!  i=0,l 

=  ID^nlHj)! 

J  J  2 

=  0  dyy(nlHi)  =  JTj  aYj(niHj)  i=0,l 


where 


and 


IL/nlHj)!  =  1 


i  =  0,1 


dyjj(nlHj)  =  E[lYj(nlHi)l2]  -  o^nlHj)  i  =  0,1. 


(6.1.22a) 

(6.1.22b) 

(6.1.22c) 

(6.1.23) 

(6.1.24) 


The  quantity  Oyj(nlHi)  denotes  the  variance  of  Yj(nlHj).  Using  eq(6.1.21),  the 
quadratic  terms  in  eq.(6.1.13b)  become 


£H(nlHi)[Kx(nln-l,Hi))*1£(nlHi)s 

=  £H(nlHi)[I^(nlHi)]-1DY1(nlHi)Lyl(nlHi)£(nlHi)  i=0,l 


(6.1.25a) 


151 


(6.1.25b) 


=  [L^  (nlHi)£(nlHi)]H  D^nlHj)  [^(nlH^nlHi)] 
=  ^H(nlHi)Dy  (nlHj^CnlHj)  i  =  0,1 


i=0,l 

(6.1.25c) 

(6.1.25d) 


where  the  last  two  equations  result  from  eqs(6.1.16)  and  (6.1.24),  respectively. 
Using  eqs(6. 1.22c)  and  (6.1.25d)  in  eq(6.1.13b),  we  obtain 


InA 


H.,H, 


J  N 

=  1 1 

j=l  n=1 


'  2 

aYj(nlHo)  |Yj(nlH0)l2  l^nlH^ 
In  2  +  2  ’2 


°7j(nlHi)  (Jy^nlHo)  ^(nlHj)  j 


(6.1.26) 


Eq(6.1.26)  may  appear  as  the  Hkcahood  ratio  for  incoherent  integration 

due  to  the  appearance  of  the  magnitude  squared  operation  on  each  error  residual 
Yj(nlHj).  We  note,  however,  that  in  the  transformation  of  the  observation 

processes  i(nlHj)  to  the  whitened  y(nlHj)  error  vector,  we  utilized  both  magnitude 

and  phase  information.  Thus,  eq(6.1.26)  provides  coherent  integration  not  only 
over  the  N  time  samples,  but  also  over  the  J  channel  processes.  It  is  the 
multichannel  likelihood  ratio  for  wide-sense,  joint  stationary,  Gaussian  processes, 
and  represents  a  generalization  of  the  single  channel  likelihood  ratio  reported  in 
[14,15,23,39]  for  Gaussian  processes.  In  sections  2.4  and  6.4,  we  discuss  a  two 
stage  filtering  method  using  multichannel  linear  prediction  filtering  which 
generates  y(nlHi)  when  the  correlation  sequence  under  each  of  the  two  hypotheses 

is  knowr  Then,  two  sets  of  filter  coefficients  and  error  variances  can  be 

obtained  exactly,  through  the  multichannel  Yule-Walker  equations.  In  this  case 
the  error  vector  Y(nlHj)  will  be  a  MMSE  output  of  the  filter  for  which  the 

hypothesis  Hj  is  true.  The  other  filter  output,  however,  will  increase  in  terms  of 
its  average  output  magnitude.  Eq(6.1.26)  indicates  that  when  Hq  is  true,  the  last 

term  will  contribute  a  larger  value  in  a  negative  sense,  causing  the  likelihood 
ratio  to  decrease.  Alternatively,  when  Hj  is  true,  the  second  term  increases  in  a 


positive  sense  so  that  the  likelihood  ratio  increases.  For  the  unknown  correlation 
case,  the  Filter  coefficients  and  error  variances  must  be  estimated.  In  this  case, 
eq(6.1.26)  becomes  a  generalized  likelihood  ratio  and  is  therefore  suboptimal. 
From  one  set  of  observation  data,  we  must  estimate  the  parameters  (ie.  the  filter 
coefficients  and  error  variances)  for  each  filter  assuming  the  appropriate 
hypothesis  is  true.  In  the  practical  implementation  for  this  case,  we  must  assume 
that  the  MMSE  filters  under  each  hypothesis  have  distinct  orders  so  that  the 
likelihood  ratio  will,  in  general,  have  a  value  other  than  zero.  This  assumption  is 

justified,  for  example,  when  characterizing  the  observation  data  as  autoregressive 
processes  where  the  order  of  the  process  under  hypothesis  Hj  (signal  present)  is 

larger  than  that  under  H0  (signal  absent).  For  single  channel  processes,  these 
considerations  have  been  treated  in  [14,16]. 

6.1.2.  Whitening  using  a  Cholesky  Decomposition 

We  now  consider  the  decomposition  of  the  positive  semi-definite  matrix 
Kx(nln-l,Hj)  via  the  Cholesky  decomposition  such  that 

Kx(nln-l,Hj)  =  C^nlltyC^nlHi)  i  =  0,1  (6.1.27) 


where  Ca(nlHj)  i=0,l  is  a  lower  triangular  JxJ  matrix  with  elements  ca  (nIHj) 

JK 

j<k.  We  again  note  that  Kx(nln-l,Hj)  is  considered  as  a  deterministic  function  of 
the  past  data.  Also,  since  this  matrix  is  positive  semi-definite,  Ca(nlHj)  is  non- 

singular.  Therefore,  from  eq(6.1.27),  we  can  obtain 


I  =  Ca(nlHj)  Kx(nln-l,Hi)  [C^nlHj)]'1  i  =  0,1 

=  Ca1(nlHi)E[£(nlHi)£H(nlHi)]  [C^nlHj)]*1 

=  EfC^nlHj) £(niHi)£H(nlHi)  [C^nlHj)]’1 } 

=  EtafrlHjte^nlHi)]  i  =  0,1 


(6.1.28a) 

(6.1.28b) 

(6.1.28c) 

(6.1.28d) 
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where 


is  0,1. 


(6.1.29) 


a(nlHi)  =  C^OilHj)  fidilHi) 

The  diagonal  form  of  eq(6.1.28d)  implies  that  fl.(nlHi)  contains 

uncorrelated  elements  across  the  channels.  Similar  reasoning  is  again  used  as 
presented  in  eqs(6.1.17)  through  (6.1  70).  We  have  from  eq(6.1.29) 

fi(nlHi)  =  Ca(nlHi)  ffl(nlHi)  i  =  0,1.  (6.1.30) 

Using  eq(6.1.30)  in  the  orthogonality  condition  of  eq(6.1.17) 

E(C0(nlHi)  a(nlHj)  flH(n'IHi)  c"(n'IH;)}  -  [0]  n#n  i=0,l  (6.1.31) 

so  that 

C0(nlHj)  E[a(nlHj)  aH(n'IHj)]  C„(n'IHi)  =  [0]  n*n'  i=0,l.  (6.1.32) 

Since  the  matrix  Ca(nlH|)  is  non-singular,  it  follows  that 

E[ffl(nlHi)  flH(n’IHi)]  =  [0]  n*n  i=0,l  (6.1.33) 

so  that  using  eqs(6.1.28d)  and  (6.1.33) 

E[£.(nlHi)flH(n,IHi)]  =  {10  i  =  0,1.  (6.1.34) 

Eq(6.1.34)  indicates  that  the  elements  of  &(nlHj)  have  unit  variances  and  are 
uncorrelated  both  in  time  and  across  channels,  from  eq(6.1.27),  we  obtain 

K^(nln-l,Hj)  =  [C^nlHi)]* 1  C^nlHi)  i  =  0,1  (6.1.35) 


and 
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i  =  0,1  (6.1.36a) 

i  =  0,1  (6.1.36b) 

is  0,1.  (6.1.36c) 

Using  eq(6.1.35),  the  quadratic  terms  in  eq(6.1.13b)  become 
£H(nlHi)[Kx(nln-l,Hi)r1£(nlHi)  = 


=  E^nlHj)]  [c"(nlHi)]'1Ca‘(nlHi)  £(nlH,) 

i  =  0,1 

(6.1.37a) 

=  [C0VnlHj)  £(nlHj)]H[Ca'  (nlHj)  £(nlHj)] 

i  *  0,1 

(6.1.37b) 

-aH(nlHj)a(nlHj) 

i  s  0,1 

(6.1.37c) 

J 

=  lotj(nlHj)l2 

i  s  0,1 

(6.1.37d) 

H 


lKx(nln-l,Hj)l  =  ICa(nlHi>l IC^CnlHf)  I 

=  A  cojj(nlHi)  g  c’ajj(nIHi) 
J 


= 0  lc°jj 


(nlHi)l- 


where  we  have  used  eq(6.1.29)  to  obtain  (6.1.37c).  Using  eqs(6. 1.36c)  and 
(6.1.37d)  in  eq(6.1.13b),  we  obtain 


J  N 

lnAu  H  =  £  Z 

H'  H»  j*l  n-1 


'  lcOjj(nlH0)l2 
‘  \ajj(nlHi)l2  + 


lcxj(nlH0)l2  -  lotj(nlH1)l2 


(6.1.38) 


A  comparison  of  eqs(6.1.38)  and  (6.1.26)  reveals  that  when  using  the 
Cholesky  matrix  to  decorrelate  the  error  vector  processes  £(nlHj),  the  resulting 

unncorrelated  error  vector  output  &(nlHj)  is  such  that  the  elements  have  unit 
variance.  From  the  equality  of  the  LHS  of  eqs(6.1.25d)  and  (6.1.37d),  we  have 


155 


J  ly;(nlHi)l2  J  , 

X  “*2 - =Xlaj(nlHi)' 

J-1  CTyj(nlHj)  J=1 


i  =  0,1. 


Similarly,  from  the  equality  of  eqs(6. 1.22c)  and  (6.1.36c) 


J  2 


n  = n  *cctii(n*Hi)i" 

j=i  J  j=i  jj 


Thus, 


In 


J  2  j 

n  aVj(nlHo)  lea^(nlH0)l: 


1  2 


~  In 


or 


2 

j  ay  (nlH0)  j  lca  (nlH0)l 

y  in ~2 —  - 

ft  ^(nlHO  j*l  [ca^nlH0{ 


i  =  0,1. 


i  =  0,1 


i  *  0,1. 


(6.1.39) 


(6.1.40) 


(6.1.41a) 


(6.1.41b) 


Thus,  each  term  in  eqs(6.1.26)  and  (6.1.38)  are  identical.  However,  in 
general,  we  note  that  each  jth  term  in  these  equations  are  not  equal  for  J>1. 

6.2.  THE  SPECIAL  CASE  OF  AN  UNCORRELATED  SIGNAL 
PROCESS 

In  [40],  several  limiting  forms  of  the  single  channel  (J=l)  likelihood  ratio 
are  discussed.  They  include  (1)  the  detection  of  a  deterministic  signal  in  additive 
white  Gaussian  noise,  (2)  the  detection  of  a  non-white  Gaussian  signal  process  in 
additive  white  Gaussian  noise,  (3)  the  moving  target  detection  (MTD)  algorithm 
for  the  detection  of  a  deterministic  signal  in  non-white  Gaussian  noise  [41,42]  and 
(4)  the  detection  of  a  non-white  Gaussian  signal  process  in  additive  non-white 
Gaussian  noise  [43].  It  is  also  shown  in  [40]  that  this  likelihood  ratio  contains  the 


156 


algorithm  developed  [44]  for  the  detection  of  a  deterministic  signal  in  additive 
non- white  Gaussian  noise  of  unknown  correlation  statistics. 

One  limiting  form  of  this  likelihood  ratio  which  has  not  been  noted  is  the 
case  of  uncorrelated  (both  in  time  and  across  channels)  Gaussian  signal  processes 
in  additive  white  noise.  In  this  case,  the  signal  is  a  white  noise  process.  Since 
past  values  of  such  a  process  are  uncorrelated  with  present  and  future  values,  the 
coefficients  in  the  linear  prediction  error  filters  are  zeroes.  Thus,  the  error 

signals  in  this  case  are  identical  to  the  observation  processes.  For  known  variance 
terms,  the  error  variances  under  each  hypothesis  for  the  scalar  error  yj(nlHj)  on 

each  channel  j 

Cyj(Ho)  =  CTwj  j  =  1,2,.. .J  (6.2.1a) 


and 

2  2  2 

Oy^Hi)  =  asj  +  Owj  j  =  1,2,...  J  (6.2.1b) 

2  2 

where  Osj  and  Gwj  are  the  known  variances  associated  with  the  jth  channel  signal 

and  white  noise,  respectively.  Absorbing  the  constant  term  into  the  threshold, 
eq(6.1.26)  becomes 


= £  • 

lxj(n)l 

2 

Owj 

m 

2 

i2  'l 


Csj  +  O  wj 


j=l  n=l 


aS5 


awj(asj  +  a  wj) 


(6.2.2a) 


(6.2.2b) 


Eq(6.2.2b)  is  the  likelihood  ratio  for  complex  Gaussian  uncorrelated  signal 
processes  in  additive  white  noise.  For  J=l,  its  form  is  noted  in  [19  Part  I,  Chap. 
2]  for  the  case  of  real  processes.  This  is  a  case  where  an  incoherent  integrator  is 
optimal;  ie.,  if  pulse-to-pulse  phase  information  were  utilized  in  the  coherent 
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integration  procedure,  it  would  not  result  in  an  improvement  in  detection 
performance.  Thus  eq(6.2.2b)  is  also  informative  from  another  point  of  view. 
We  recognize  that  it  has  the  form  of  an  incoherent  integrator  [13].  In  section  6.4, 

we  discuss  the  implementation  of  eq(6.1.26)  with  a  dual  filter  strategy,  where 
each  filter  is  designed  for  the  hypothesis  Hj  i=0,l,  respectively.  The  detection 

results  obtained  using  this  equation  will  be  compared  to  analytic  expressions  for 
coherent  pulse  train  detection  presented  in  Appendix  K.  In  addition,  we  will  plot 
the  detection  results  obtained  when  the  coefficients  of  these  filters  are  set  to  zero; 
ie.,  the  results  obtained  when  the  likelihood  ratio  is  equivalent  to  eq(6.2.2b). 
These  results  are  compared  to  the  analytic  expressions  for  incoherent  pulse  train 
detection  also  presented  in  Appendix  K. 

6.3.  GAUSSIAN  PROCESSES  WITH  UNCONSTRAINED 
QUADRATURE  COMPONENTS 

In  this  section,  we  generalize  the  derivation  of  the  likelihood  ratio  to 
Gaussian  processes  with  unconstrained  quadrature  components.  We  will 
therefore  consider  a  zero-mean,  complex  baseband  process  Xj(n)  for  channel  i 

such  that 


Xi(n)  =  xu(n)  +  j  xiQ(n)  n  =  1,2, ...,  N  (6.3.1) 

where  x^n)  and  Xjq(n)  are  the  real  and  imaginary  components  of  the  process 
xj(n),  respectively.  We  now  define  the  vectors 


=  UjO)  ij(2) ...  ij(N)] 

(6.3.2a) 

and 

^  =  [^(1)^(2)...^)] 

(6.3.2b) 

where 

ijOO  =  [xn(k>  x2i(k) ...  Xjj(k)] 

(6.3.2c) 

iq(k)  =  [x1Q(k)  x2qOO  ...  XjQ(k)]. 

(6.3.2d) 

Note  that 
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«  M 

II  II 
&  ■£. 

(6.3.3a) 

(6.3.3b) 

We  now  consider  the  concatenated  real  vector  j*1>N  defined  as 

(6.3.4) 

Under  hypothesis  Hj  i=0,l  the  real  vector  is  defined  to  be  Gaussian  if 

and  only  if  its  density  function  is  of  the  form 

PR^Iu^i) =  1  exP  {'rfli.N  "lud  tll.N  "Xi^l } 

[(2*)2JNIKy.l  ]5 

(6.3.5) 

Kff  *  e{  (ll,N  'Xus|][ll,N  *Il^|]T} 
and 

(6.3.6a) 

tlJ4  = 

(6.3.6b) 

Since  the  means  are  assumed  to  be  known  'a  priori',  they  can  be  subtracted 
from  the  data  and  there  is  no  loss  in  generality  by  assuming  zero-mean  processes. 

By  definition,  PR(ii,N*Hi)  is  a  2JN-dimensional  multivariate  density  function  for 

the  real  random  variables  contained  in  eqs(6.3.4).  We  now  express  Pr^i^IHj)  as 
the  product  of  conditional  densities  so  that 

i 

i 

pR(lijNIHi)  =  PR[lO)IHi]  n  PR[l(n)l£lfn.lfHi]  i  =  0,1 

n=Z 

(6.3.7) 

where 

lT(k)  =  [i[(k)  x£(k)] 

=  [Xn(k)  x2I(k) ...  Xj!(k)  x1Q(k)  x2Q(k) ...  xJQ(k)] 

(6.3.8a) 

(6.3.8b) 
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(6.3.8c) 


tu  =  fold)  &q(1)] 

and  all  the  conditional  densities  are  multivariate  jointly  Gaussian.  The  mean  of 
the  multivariate  conditional  density  isi(nln-l,Hj);  ie.,  the  linear 

MMSE  predictor  of  i(n)  using  past  data  rt  n_j  and  assuming  Hj  is  true.  The  2Jx2J 
covariance  matrix  of  this  density  function  is  the  conditional  covariance  matrix 
Kr(nln-l,Hj)  such  that 

K.r(nln-l,Hj)  =  E{  (r(n)  -  t(nln-l,Hi))[i(n)  -  l(nln-l,Hi))T}  (6.3.9a) 

=  E  [s(nlHj)£T(nlHi))  n  =  1,2 N  i  =  0,1  (6.3.9b) 

where 

£(nlHj)  =  r(n)  -  ftnln-l.Hj)  i  =  0,1  (6.3.10a) 


is  the  zero-mean  2Jxl  error  vector.  When  i(nln-l,Hj)  is  obtained  using  a  linear 
combination  of  p  past  data  samples,  we  define 


£^(nln-l,  ....n-p.Hj) 


(6.3.10b) 


T 

where  the  2Jx2J  block  matrix  ^(klHj)  is  expressed  in  terms  of  its  JxJ  block 
elements  such  that  (dropping  the  notation  Hj) 


T  T 

Apn(k)  Ap2,(k) 

T  T 

APl2(k)  Ap22(k) 


(6.3.10c) 


We  note  that  this  real  estimator  is  of  higher  dimension  than  the  complex 
estimator  defined  in  eq(2.4.1d).  The  increased  dimension  provides  this  estimator 
with  the  necessary  degrees  of  freedom  to  whiten  quadrature  components  of 
processes  with  more  general  correlation  between  the  quadrature  components  than 
is  allowed  by  the  conventional  complex  Gaussian  process  as  was  discussed  in 
section  4.6.  In  Appendix  M,  we  show  that  the  complex  estimator  of  eq(2.4.1d)  is 
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T  T  T  T 

limited  to  the  special  case  where  Apn(k)=Ap22(k)  and  Ap12(k)=-Ap21(k)  and 
whitens  the  quadrature  components  only  for  the  special  conditions  RI^X(I)=R^(I) 
and  rS(I)=-r£(I).  The  conditional  density  functions  can  now  be  expressed  in 
terms  of  the  quadratic  form  such  that 


pR[r(n)!£i  n»Hil  = 


1 


[(2TC)2JNIKr(nln-l,Hi)l]2 

exP  { *2fr(n)-i  (nln- 1  ,Hi)]T[Kr(nln“  1  *Hi>] 4  [r(n)-i(nln-1,Hi)] } 

i  =  0,1  (6.3.11) 


and 


£(llO,Hi>-Q 


i  =  0,1. 


(6.3.12) 


Using  eq(6.3.10a)  in  (6.3.11),  we  obtain 


pR[l(n)l£1(Il,Hi]  = 


1 


[(27t)2JNIKr(nln-l,Hi)l]2 

exp  {  4£T(nlHi)[Kr(nln-l,Hi)]*1£(nlHi) }  i  =  0,1  (6.3.13) 


where 


PR[l(l)IHi] «  pjt[fi(l)IHj] 


i  =  0,1 


(6.3.14a) 


[(27T)2JNIKr(110,Hi)l]2 


7  exp  {  Va'H^tKrd'OWl'^d'Hi) } 


i  =  0,1. 


(6.3.14b) 


We  can  now  express  the  likelihood  ratio  for  the  multivariate  joint  Gaussian 
density  function  of  the  quadrature  components  as 
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vf .  y-'-fl-x 

**-  V  •*,. 


.  Q  Pr^ijM) 

Ah''",=PrWHo) 

(prWDIH,)  n,PR(t(n)W,.Hil) 

(prWDIHo!  npR(c(n)ll1J1.„H0)) 
n*2 


(6.3.15a) 

(6.3.15b) 


where  the  last  equality  results  from  eq(6.3.7)  and  superscript  Q  denotes  the 
quadrature  form.  Substituting  eqs(6.3.13)  and  (6.3.14)  into  (6.3.15b),  we  have 

n  IKr(nln-l,H0)l2  exp{  -^^(nlH^tK^nln-UH^l'^nlHi)} 

Ahj.Hq  —  n  i  • 

II  IK^nln-l,^)!2  expt-ls^nlHoXK^nln-l.Ho)]’1^!^)} 
n=i 

(6.3.16a) 

Taking  the  natural  logarithm,  we  obtain 

Q  1  N  r  IKr(nln-l,H0)l  T  , 

hiAHj.HQ  =  2  I  [lniK^(nin^,H[)l +  £T(n,Ho)[Kr(nln'1’Ho)]'  fe(nlH0) 

-  fiT(nlH1)[Kr(nln-l,H1)]’1fi(nlH1)].  (6.3.16b) 

The  error  vector  g.(nlHj)  i— 0,1  in  eq(6.3.16b)  has  been  ’whitened’ 

temporally.  However,  it  still  retains  correlation  across  channels.  Furthermore, 

all  the  quadrature  components  retain  cross-channel  correlation.  We  will  now 
consider  a  diagonalization  of  Kr(nln-l,H0)which  will  decorrelate  the  vector 

£(nlHj)  across  channels  and  between  quadrature  components.  Although  several 

decompositions  could  be  used,  we  will  again  focus  on  the  LDLT  and  Cholesky 
CCT  decompositions. 

6.3.1.  Whitening  Across  Channels  and  Quadrature  Components  via 
LDLt  Decomposition 

In  this  section,  we  perform  an  LDLT  decomposition  of  the  positive  semi- 
definite  matrix  Kr(nin-l,Hj)  to  remove  the  cross-channel  and  quadrature 
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correlation.  We  again  note  that  the  matrix  Kr(nln-l,Hj)  is  a  deterministic  function 
[1]  of  the  past  observation  data.  Therefore, 

Kr(nln-1,H|)  =  L¥(nlHi)D¥(nlHi)L^(nlHi)  i  =  0,1  (6.3.17) 

where  L^nlHj)  is  a  unit  diagonal,  lower  triangular  2Jx2J  matrix.  Solving 
eq(6.3.17)  for  D¥(nlHj),  we  obtain 

D¥(nlHi)  =  L¥1(nlHi)Kr(nln-141i)[Ly(nlHi)]-1  i  =  0,1  (6.3.18a) 

=  E{L¥(nlHi)£(nlHi)£T(nlHi)[L^(nlHi)r1)  i  =  0,1  (6.3.18b) 

=  ElmOilHjJilftnIHi)]  i  =  0,1  (6.3.18c) 

where 

4 

^(nlHj)  =  L^(nlHi)fi(nlHi)  i  =  0,1  (6.3.19a) 

=  L¥(nlHi)  T  fii(nlHi)1  i=  0,1.  (6.3.19b) 

[ggCnlHj) 

The  vector  ^(nlHj)  i  =  0,1  can  be  expressed  as 

HlT(nlHi)  =  [j|(I(nlHi)  Hil(nlHi)]  i  =  0,1.  (6.3.20) 

The  diagonal  form  of  eq(6.3.18c)  implies  that  m.(nlHj)  is  uncorrelated  across 
channels  and  quadrature  components;  thus, 

E(l|lA(nlHj)jfe(nlHj))  =  [0]  i  =  0,1.  (6.3.21) 

From  eq(6.3.17),  we  now  have 

(Kr(nln-l,Hj)r*  =  (L¥(nlHi)]'1D¥(nlHi)L^(nlHj)  i  =  0,1  (6.3.22) 
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and 


lKr(nln-lJlj)l  =  lLy(nlHj)l  lDv(nlHj)l  liynlHj)! 

i  =  0,1 

(6.3.23a) 

=  lDv(nlHi)l 

i  =  0,1 

(6.3.23b) 

»  Q  di|A(nlHi)  dJB(n,Hi 

i  =  0,1 

(6.3.23c) 

J  2  2 

•  ni0yjA(n|Hi)<NdB(n'Hi) 

i  =  0,1 

(6.3.23d) 

where 

iL^nlHj)!  =  1 

i  =  0,1 

(6.3.24) 

and 

dJjA(nlHi)  =  E[(vJA(nlH,)]2]  s  o^nlHj) 

i  =  0,1 

(6.3.25a) 

and 

djjB(nlH;)  =  E[[yjB(nlH,)]2]  s  o^nlHj) 

i  =  0,1. 

(6.3.25b) 

2  2 

The  quantities  a^j^nlHj)  and  OyjQ(nlHj)  denote  the  variances  of 

the  A  and 

B  components,  respectively.  Using  eq(6.3.22),  the  A  and  B  component  terms  in 
eq(6.3.16b)  become 


£T(nlHj)[KI(nln-l,Hj)]‘*£(nlHi)  = 


=  £T(nlHj)  [L^(nlHi)]‘lD^(nlHi)L^(nlHi)£(nlHi) 

i=0,l  (6.3.26a) 

=  [Ly(nlHj)  £(nlH,)]T  (nlHjJL^nlHj)  s(nlH,) 

i=0,l  (6.3.26b) 

=  JlftnlHj)  Dy(nlHj)  ntfnlH;)  i  =  0,1 

(6.3.26c) 

l  [ViA(nlHi)]2  (VjB(nlHi)]2 

-  X  2 - +  J  2 -  >-<M 

(6.3. 26d) 

J=1  °M0a 
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where  the  last  two  equations  result  from  eqs(6.3.19a)  and  (6.3.25),  respectively. 
Using  eqs(6.3.23c)  and  (6.3.26d)  in  eq(6.3.16b),  we  obtain 


O  l  J  N 

lnASlJJo  =  |S  I 

Z  1=1  n=l 


aVjA(n!Ho) 

ln-^ - 


oVjB(»lHo)  (VjA(nlHo)]2 
+  ln  2  +2 


[yjBCnlHo)]2  [VjACnlHj)]2  [\|/jB(nlF*)l2 

+  2  2  '  2 

<^iB(n\H0)  ^(nlHj)  °VjB(nlH1) 


(6.3.27) 


Eq(6.3.27)  is  the  generalization  of  the  multichannel  likelihood  ratio  expressed  in 
eq(6.1.26)  for  processes  with  correlated  Gaussian  quadrature  components.  For 
the  special  case  where  *(n)  has  the  correlation  properties 

Ry(l)  =  R^(l)  all  i,j  (6.3.28a) 

and 

Rif(l)  =  -  Ry'(D  all  i j  (6.3.28b) 


it  can  be  shown  (see  Appendix  I)  that  the  complex  process  y(nlHj)  discussed  in 

section  6.1  and  the  quadrature  components  presented  in  this  section  can  be  related 
as 


2  2 

oVjA(n.H0)  & 

In  2  +  In  j 

C¥jA(nlH!)  Oyi^nlHi) 


2 

Oy.dilHo) 
ln-y - 

Oy^nlHj) 


(6.3.29a) 


and 
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"H-  ■  ■ 


r_>  -'  JC-1J  ",  4 


■vr 


v  H^se- 


[\l/iA(nlHi)]2  [ViB(n,Hi)]2* 
—  — 2  +  2 

°HOa 


=  2 


l  l?i(nlHi)l2 
j=l  o^(nlHj) 


Using  these  expressions,  eq(6.3.27)  reduces  to  that  of  eq(6.1.26). 


(6.3.29b) 


6.3.2.  Whitening  across  Channels  and  Quadrature  Components  via 
a  Cholesky  Decomposition 

We  now  consider  the  decomposition  of  K/nln-UH*)  using  the  Cholesky 
decomposition  such  that 


Kr(nln- 1  ,Hi)  =  Ct(nlHi)Cx  (nIH  *)  i  = 

0,1 

(6.3.30) 

where  C^nlHj)  i=0,l  is  a  lower  triangular  2Jx2J  matrix.  From  eq(6.3.30),  we 

can  obtain 

I2J  =  C',l(nlHj)  n.r(nln-l,Hj)  [Ct(nlHj)]' 

i  =  0,1 

(6.3.31a) 

J  j 

=  c*x  (nlHj)  E  LsL(niHi)£T(nlHi)i  [Cx(nlHi>]' 

i  =  0,1 

(6.3.31b) 

E  {  Ctl(nlHi)  £(nlHi)£T(nlHi)  [C^nlHj)]'1 } 

i  =  0,1 

(6.3.31c) 

=  ELi  ‘  ;)lr  (nIHj)] 

i  =  0,1 

(6.3. 3  Id) 

where 

i(nlHj)  =  C’Vr'Hj)  s(nlHj) 

i  =  0,1, 

(6.3.32a) 

IT(nlHi) « (lI(nlHi)  jJ(nlHj)] 

i  =  0,1 

(6.3.32b) 
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and  I2j  is  a  2Jx2J  identity  matrix.  The  diagonal  form  of  eq(6.3.31d)  implies  that 
l(nlHj)  is  uncorrelated  across  channels  and  quadrature  components.  Using  the 
quadrature  form  for  l(nlHj)  defined  in  eq(6.3.32)  in  (6.3.3 Id),  we  obtain 


E[lA(nlHi)lI(nlHi)]  =  E[lB(n!Hi)lJ(nlHj)]  =  Ij  i  =  0,1  (6.3.33a) 

and 

E[lA(nlHi)iB(nlHj)]  =  EtfeOilHittldilHj)]  =  [0]  i  =  0,1  (6.3.33b) 

where  Ij  is  a  JxJ  identity  matrix.  Thus,  the  variances  of  the  quadrature 

components  of  Xj(nlHj)  i=0,l  and  j=l,2,...J  are  unity.  From  eq(6.3.30),  we 

obtain 

Kf1(nln-l,Hi)  =  (C^nlHjJl^C’^nlHi)  i  =  0,1  (6.3.34) 

and 

lKr(nln-l,Hj)l  =  IC,(nlHj)IIC,(nlHj)l  i  =  0,1  (6.3.35a) 

*  IJ  ^("'HilCtB^nlHi)^  ctAjj(nlHi)cTBjj(nlHi)  (6.3.35b) 
JJ  ,  J  , 

=  n  [ctAjjd'lHi)]  [ctBij(nlHi)]'S  1  =  0,1.  (6.3.35c) 


Using  eq(6.3.34),  tho  quadratic  terms  in  eq(6.3.16b)  become 
£T(nlHi)(Kr(nln-l,Hi)]-|£(nlHi)  = 


=  £T(nlHj)  [C^(nlH j)]' 'C^' (nIHj)  £(nlH,) 

i  =  0,1 

(6.3.36a) 

=  IT  (nlHj)l(nlH  j) 

i  =  0,1 

(6.3.36b) 

=  (lI(nlHj)  iJ(nlHj)] 

■lA(nlHi)- 

leCnlHj) 

i  *  0,1 

(6.3.36c) 

=  l^nlHi^nlHi)  +  ^(nlHj^nlHj) 

i  =  0,1 

(6.3.36d) 
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i  =  0,1 


(6.3. 36e) 


=  X  [tLdilHj)  +  WnlH;)] 

J=1 

where  eq(6.3.32a)  is  used  to  obtain  (6.3.36b).  Using  eqs(6.3.35c)  and  (6.3. 36e) 
in  (6.3.16b),  we  obtain 


o  l  J  N 

X 

j=l  n=l 


In 


[^..(nlHo)]2  [ctfUnlHo)] 


CcXAjj(n*H1)]'< 


+  ln: 


[c^nlH^r 

[^A(nlH0)  +  tjB(nlH0)]  -  [Tj^nlHj)  +  ^(nl^)] 


(6.3.37) 


As  in  the  previous  section,  when  eqs(6.3.28)  hold,  we  have  (Appendix  J) 


N 


X 

n=l 


[CtA  (nlHo)]2  [ctB  <nlH0)]2 
[^(nlH,)]*  [cTBj.(nlH,)]2 


lca  (nlHo)l2 

In — U - j 

lcajj(nlH,)l2 


(6.3.38a) 


(6.3.38b) 


so  that  eq(6.3.37)  reduces  to  eq(6.1.38). 


6.4.  SYSTEM  ARCHITECTURE  FOR  THE  LIKELIHOOD  RATIO 
EVALUATION 

In  this  section,  we  describe  an  implementation  of  the  system  to  evaluate  the 
likelihood  ratios  presented  above.  The  practical  implementation  of  systems  to 
evaluate  these  expressions  involves  several  assumptions.  In  this  dissertation,  it  is 
assumed  that  the  signal  and  non-white  clutter  processes  defined  in  chapter  3  are 
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modelled  as  autoregressive  processes  embedded  in  additive  white  Gaussian  noise. 
We  note,  however,  that  the  addition  of  these  underlying  processes  leads  to  an 
autoregressive  moving  average  (ARMA)  observation  process.  Thus,  a  filtering 
strategy  for  'whitening'  the  observation  data  as  discussed  previously  in  this 
chapter  and  section  2.4,  should  employ  ARMA  filters.  However,  algorithms 
involving  estimates  of  the  ARMA  parameters  to  update  the  filter  weights  are 
computationally  intensive  and  require  further  investigation  in  terms  of  stability 
issues.  A  more  practical  approach,  which  is  used  in  this  work,  approximates  the 
received  ARMA  observation  process  by  an  AR  process.  Although  an  AR  process 
of  infinite  order  is  required  to  exactly  model  an  ARMA  process,  an  adequate 
approximation  can  be  made  with  an  AR  process  of  'sufficiently  high'  order  [36]. 
As  a  result,  the  observation  processes  in  the  remainder  of  this  work  are  treated  as 
though  they  are  AR  processes.  The  system  architecture  for  the  evaluation  of  the 
likelihood  ratios  can  then  be  realized  with  the  filtering  methods  described  in 
section  2.4;  ie.,  with  prediction  error  filters  using  tapped  delay  lines  and  lattice 
structures. 

In  the  investigation  conducted  in  this  dissertation  and  reported  in  the  next 
section,  the  signal  and  clutter  processes  are  synthesized  as  AR  processes  (see 
chapter  4)  and  added  to  white  noise.  In  order  to  determine  an  approximate  AR 

model  for  the  received  ARMA  process,  it  is  first  necessary  to  determine  the 
model  order.  In  general,  the  order  is  larger  under  hypothesis  Hj  due  to  presence 

of  the  signal  [16].  Once  the  orders  under  Hq  and  Hj  have  been  selected,  the 

coefficients  for  the  AR  models  which  approximate  the  ARMA  processes  under 
the  two  hypotheses  can  be  obtained.  These,  in  turn,  determine  the  prediction 
error  filter  coefficients.  In  chapter  7,  two  cases  are  considered  depending  upon 
whether  the  parameters  of  the  underlying  processes  are  known  'a  priori'  or  must 
be  estimated  from  the  data. 
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6.4.1.  System  Architecture  for  Gaussian  Processes 

The  likelihood  ratios  of  eq$(6.1.26)  and  (6.1.38)  are  presented  again  for 
easy  reference;  ie., 


'  2  ' 
j  N  Oyj(nlHo)  iYj(nIH0)l2  lYj(nlHi)!2 
lnAjj  pj  s  X  ^  1  In  2  +  2  ”2 

"  0  J-l  "-1  [  <Jyj(nlHi)  OyjdilHo)  o^nlH,)  J 

J  N 

=  1  I  lnACtyn) 

j=l  n=l  J 


(6.4.1a) 


(6.4.1b) 


where 


lnA(Yj,n)  =  S 


'  2 

aYj(nlHo)  iYj(nlH0)l2  ^(nlHj)!3 
ln~2  +  2  ‘2 


Oyj(nlHj)  Cyj(ntHQ)  Oyj(nlHj)  J 


and 


J  N 

inAH  H  =  y  y 

H,'H°  jTi  n- 1 


J  N 

=  J  X  lnA(aj,n) 
j-  l  n--*l 


ICa-XnlHo)!2 


(6.4.1c) 


(6.4.2a) 

(6.4.2b) 


where 


lnA(<Xj,n) 


lc0jj(nlHo)l2 

tai^i^+lai(nlHo)l^ !-|«j(n|H1)l2| 


(6.4.2c) 


A  block  diagram  of  the  system  architecture  that  implements  the  likelihood 
ratio  of  eq  (6.4.1)  is  shown  in  Fig.  6.4.1.  This  is  the  multichannel  extension  of 
the  implementation  reported  in  [16,23].  The  lower  branch  is  used  to  compute  the 
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Figure  6.4.1  Multichannel  Likelihood  Ratio  Architecture 


second  term  and  the  numerator  of  the  first  term  in  eq(6.M),  while  the  upper 

branch  determines  the  third  term  and  the  denominator  of  the  first  term.  The 
quantity  Yb  is  the  threshold  for  the  decision  procedure  and  is  discussed  in 

Appendix  K.  As  noted  above  (and  discussed  in  more  detail  in  chapter  7),  the 
specific  choice  of  the  prediction  error  filter  structure  will  depend  on  the  assumed 
underlying  model  of  the  observation  processes  [20].  A  multichannel  forward 
prediction  error  filter  using  a  tapped  delay  line  architecture  is  shown  in  Fig. 
6.4.2.  A  lattice  structure  for  the  single  channel  case,  utilizing  both  forward  and 
backward  coefficients,  is  shown  in  Fig.  6.4.3.  An  extension  ot  i>e  lattice  filter  to 
the  multichannel  case  was  shown  in  Fig.  2.4.4  and  is  again  .  hewn  in  Fig.  6.4.4. 
Since  these  realizations  are  based  on  AR  processes,  whereas  the  actual 
observations  are  from  ARM  A  processes,  the  order  of  the  realizations  shown  in 
Figs.  6.4.2  through  6.4.4  should  be  infinite.  In  practice,  a  finite  order  is  used 
resulting  in  approximations  to  the  innovations  processes. 

6.4.2.  Implications  of  the  Estimation  Procedure 

We  now  consider  various  implementations  depending  upon  the  amount  of 
'a  priori'  statistical  knowledge  available  regarding  the  observation  processes 
under  the  two  hypotheses.  This  knowledge  is  utilized  to  determine  both  the 
prediction  error  filter  coefficients  and  error  variances  for  each  hypothesis.  In 
this  subsection,  we  will  consider  approximations  to  the  likelihood  ratios  which 
depend  on  the  extent  of  our  knowledge  regarding  these  ’a  priori’  statistics.  For 
the  scaler  case,  similar  approximations  are  presented  by  Zhang  and  Haykin  [20]. 

Case  l 

In  this  case,  the  statistical  properties  of  the  observation  processes  under 

both  hypotheses  are  considered  to  be  known  ’a  priori’.  Treating  the  observation 
processes  as  AR  processes,  the  filter  coefficients  for  F0  and  Fj  as  well  as  the 

error  variances  are  known  exactly  and  eqs(6.4.1)  and  (6.4.2)  provide  an  exact 

determination  of  the  likelihood  ratio.  In  this  case,  the  first  term  in  each 
likelihood  ratio  is  a  constant  and  can  be  incorporated  into  the  threshold,  Yb.  And 

so,  these  equations  reduce  to 
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X (n)^  rm  a(n-l)  r~n  » (n-D HID  ^  I~u1  X("-P) 
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£o(n) 
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J 

lnA  u  H  -  X 

M1*M0  jTj 


'  l7i(nlH0)l2 

<  2 - 

<jyj(nlH0) 


lYj(nlHi)l2 

<4j(nlH,) 


and 

'nA'„1,„0  -  I  I  {  lotj(nlH0)l2  -  lotj(nlHI)l2  }  , 


(6.4.3) 


(6.4.4) 


respectively.  In  this  case,  when  hypothesis  H0  is  true  (ie.,  no  signal  present), 
filter  F0  provides  MMSE  vector  outputs  while  filter  Ft  produces  much  larger 

error  residuals.  Thus,  the  likelihood  ratios  decrease  due  to  the  increase  in  the 
second  terms  in  eqs(6.4.3)  and  (6.4.4).  When  Hj  is  true,  the  situation  reverses 

and  the  likelihood  ratios  increase  as  the  first  terms  increase. 


Cass  2  A 

In  this  case,  no  ’a  priori'  information  is  available  to  obtain  the  prediction 
error  filter  coefficients.  However,  complete  knowledge  is  assumed  regarding  the 
prediction  error  variance  terms.  This  will  be  the  situation  when  large  amounts  of 

'a  priori'  data  are  used  to  obtain  the  error  variances.  The  prediction  error  filter 
coefficients  for  F0  and  Fj  are  obtained  by  processing  the  received  data  as  will  be 

explained  in  section  6.4.3.  In  this  case,  the  likelihood  ratios  become 


hAv<.“5 


N 


1 

n=l 


'^(nlHo)l2  l'Vj(nlH1)l2 

\  2  '2 
o7.(nlH0)  Cy.fnIHj) 


(6.4.5) 


J  N 

lnAHl  H„  =  I  I  {  l&j(nlH0)l2  -  IdjCnlH!)!2  }  (6.4.6) 

1  0  j=l  n«l  J  J 

where  a  denotes  the  estimated  values.  We  again  note  that  the  architecture  in  Fig. 
6.4.1  utilizes  two  prediction  error  filters  (PEF)  implemented  in  parallel  with 
each  designed  to  be  an  optimal  estimator  under  the  given  hypothesis.  However, 
in  this  case,  only  one  hypothesis  is  true  and  only  one  set  of  observation  processes 
are  available  which  must  be  utilized  to  set  the  weights  of  both  filters.  Thus,  if 
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both  filters  are  of  equal  order,  their  coefficients  (and  consequently  their  outputs) 
will  be  equivalent.  However,  filter  Flf  designed  for  the  hypothesis  Hj  data,  is 
chosen  to  be  of  higher  order  than  that  of  F0.  This  is  justified  on  the  basis  that  the 
underlying  process  under  Hj  is  approximated  by  a  higher  order  AR  process  due 
to  the  presence  of  the  random  signal  [16,23].  When  Hj  is  true,  the  Fj  filter 
designed  for  the  Hj  processes  adapts  to  the  new  process.  However,  the  F0  filter 
designed  for  the  Hq  process  produces  a  larger  error  output  since  this  lower  order 

filter  now  operates  on  a  higher  order  AR  process.  Therefore,  it  cannot  adapt  to 
the  underlying  process  coefficients.  As  a  result,  the  first  summations  in 
eqs(6.4.5)  and  (6.4.6)  increase.  Since  this  term  provides  a  positive  contribution 

to  the  likelihood  ratio,  it  is  the  mechanism  which  raises  the  likelihood  above  a 
predetermined  threshold  under  Hr  On  the  other  hand,  when  H0  is  true  and  there 

is  a  large  amount  of  data  available,  the  output  from  the  Fj  filter  is  likely  to  be 
close  to  that  from  the  F0  filter.  This  result  occurs  because  the  additional 
coefficients  of  the  Fj  filter  are  likely  to  be  negligible,  while  the  remaining 
coefficients  are  likely  to  be  close  to  those  of  the  F0  filter. 

Case.  £6 

In  this  case,  as  in  case  2A,  observation  data  is  used  to  estimate  the 
prediction  error  filter  coefficients  while  complete  knowledge  is  assumed 
regarding  the  prediction  en-or  variance  terms.  Whereas,  the  filter  coefficients 
were  estimated  in  case  2A  using  one  set  of  available  observation  data,  they  are 
estimated  in  case  2B  using  data  available  under  both  hypotheses.  This  procedure 
will  enable  us  to  utilize  large  quantities  of  data  to  accurately  determine  the 
coefficients  under  both  hypotheses.  The  likelihood  ratios  for  this  case  are  the 
same  as  those  for  case  2A.  However,  in  the  limit  as  the  estimated  coefficients 
(for  both  hypotheses)  approach  the  true  parameters  of  the  processes,  the 
likelihood  ratio  approaches  that  of  case  1 . 


6.4.3.  Filter  Coefficient  Determination 

The  filter  coefficients  can  be  determined  via  several  approaches.  For 
wide-sense  stationary  processes,  the  pth  order  filter  coefficients  Ap(k)  and 
forward  prediction  error  covariance  matrix  [If]p  could  be  estimated  via  the 
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Levinson-Wiggins-Robinson  (LWR),  the  Strand-Nuttall  and  the  Vieira-Morf 
methods  [7,8,9,10,29].  For  the  LWR  method,  estimates  of  the  correlation 
sequence  are  obtained  by  recursive  update.  Since  this  method  utilizes  correlation 
sequence  estimates,  it  is  anticipated  to  yield  less  accurate  estimates  of  the 
coefficients  than  the  Strand-Nuttall  or  Vieira-Morf  approaches  for  the  same 
reasons  as  noted  by  Burg  [35]  in  the  single  channel  case;  ie.  the  unbiased  estimate 
of  the  correlation  matrix  may  not  be  positive  semi-definite  and  therefore 
physically  unrealizable.  On  the  other  hand,  the  biased  estimate  may  yield 
inaccurate  estimates,  especially  for  limited  data.  The  Strand-Nuttall  method  (the 
multichannel  generalization  of  the  Burg  algorithm),  however,  estimates  the  filter 
coefficients  directly  from  the  data  thus  bypassing  the  requirement  to  first  estimate 
the  correlation  matrix.  The  reflection  coefficients  for  the  single  channel  or 
multi-channel  cases  are  estimated  by  this  algorithm  and  applied  to  the  lattice  filter 
structures  shown  in  Figs.  6.4.4  and  6.4.5,  respectively.  From  these  estimates,  the 
autoregressive  coefficient  matrices  Am(^)  [as  well  as  the  backward  coefficients] 

can  be  determined  and  used  as  the  filter  coefficients  (see  chapter  2). 

The  additional  second  stage  multichannel  filter  coefficients  [L  v  J’1  and  [CL]'1 

ip 

discussed  in  chapter  2  must  also  be  determined  in  order  to  use  the  simplified 
form  of  eqs(6.1.26)  and  (6.1.38),  respectively.  These  coefficients  complete  the 
spatial  whitening  of  the  £(n)  process  via  eq(6.1.16)  and  (6.1.29),  respectively. 
An  LDLH  decomposition  of  the  error  covariance  matrix  [Lf]p=E[£(n)£H(n)]  yields 

the  lower  triangular  unit  diagonal  Ly  matrix  which  is  an  estimate  of  Lu.  The 
inverse  of  Ly  is  the  matrix  coefficient  that  we  desire  in  the  second  stage  of  the 

filter.  Similarly,  a  Cholesky  decomposition  CCH  of  [Ef]p  provides  the  matrix 


Finally,  we  point  out  that  coefficients  for  the  more  general  linear  estimator 
£(n)  proposed  in  section  6.3  could  be  obtained  using  the  same  form  as  algorithms 
proposed  for  wide-sense  jointly  stationary  complex  baseband  processes;  ie., 
algorithms  such  as  the  Strand-Nuttall  and  Vieira-Morf  could  be  used  but  extended 
to  the  quadrature  form.  Although  the  matrices  become  2Jx2J  rather  than  JxJ,  the 
resulting  likelihood  ratios  are  capable  of  processing  the  more  general  class  of 
Gaussian  processes  with  unconstrained  quadrature  components.  We  note  that  for 
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this  class  of  processes,  the  narrowband  bandpass  processes  could  be  non¬ 
stationary. 

In  this  chapter,  we  initially  derived  a  multichannel  likelihood  ratio  for 
complex  Gaussian  processes.  The  approach  was  model-based  and  utilized 
multichannel  innovations  processes.  Two  generalized  likelihood  ratios  were 
considered  using  the  LDLH  and  Cholesky  CCH  decompositions  on  the  error 
covariance  matrix  to  whiten  across  channels.  These  likelihood  ratios  were  then 
extended  to  consider  the  more  general  class  of  Gaussian  processes  with 
unconstrained  quadrature  components.  In  this  development,  we  proposed  an 
estimator  capable  of  whitening  not  only  the  complex  processes,  but  also  their 
quadrature  components.  The  implementation  of  these  likelihood  ratios  is 
discribed  in  section  6.4.  In  this  dissertation,  the  parameter  estimation  is 
performed  directly  on  the  wide-sense  stationary  baseband  processes  as  shown  in 
Fig.6.4.1.  We  note,  however,  that  this  implementation  architecture  is  amenable 
to  adaptive  estimators  which  would  use  the  feedback  from  the  error  vectors. 
Finally,  we  pointed  out  that  coefficients  for  the  more  general  linear  estimator 
£(n)  proposed  in  section  6.3  could  be  obtained  using  the  same  form  as  algorithms 
proposed  for  wide-sense  jointly  stationary  complex  baseband  processes. 
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CHAPTER  7 

DETECTION  PERFORMANCE  EVALUATION:  PROCEDURE  AND 

NUMERICAL  RESULTS 

7.1.  GENERAL  DESCRIPTION 

In  this  section,  we  describe  the  procedure  used  to  implement  the  detection 
scheme  described  in  section  6.4  for  performance  evaluation.  We  again  indicate 
that  this  implementation  involves  several  assumptions.  First,  we  note  that  we  are 
modeling  the  signal  and  clutter  as  autoregressive  (AR)  processes  of  specific 
orders.  For  sufficiently  high  orders,  the  AR  models  can  yield  suitable 
approximations  of  the  true  physical  processes  observed  in  practice.  However, 
when  these  AR  processes  are  added  to  a  white  noise  process  to  form  the  received 
process  (also  refered  to  as  the  observation  process),  an  ARMA  process  results. 
Since  our  implementation  is  based  on  an  AR  model  for  the  observation  processes, 
it  is  necessary  to  approximate  the  received  ARMA  observation  process  as  an  AR 
process.  As  noted  previously,  an  ARMA  process  can  be  modeled  as  closely  as 
desired  by  an  AR  model  of  ’sufficient’  order  [36].  These  AR  models  enable  us  to 
implement  prediction  error  filters  with  tapped  delay  lines  and  lattice  structures  in 
the  detection  architecture  as  described  in  sections  2.4  and  6.4. 

In  the  numerical  investigation  conducted  here,  the  signal  and  clutter 
processes  are  synthesized  as  AR  processes  (see  chapter  4)  and  added  to  white 
noise.  In  order  to  determine  the  approximate  AR  model  for  the  received  ARMA 

process,  it  is  first  necessary  to  determine  the  model  order.  In  general,  the  order 
is  larger  under  hypothesis  Hj  due  the  presence  of  the  signal  [16].  Once  the  orders 

under  H0  or  Hj  have  been  selected,  the  coefficients  for  the  AR  model  which 

approximate  the  ARMA  process  under  each  hypothesis  can  be  determined.  These 
in  turn  determine  the  prediction  error  filter  coefficients.  Two  cases  will  be 
considered  depending  upon  whether  the  parameters  of  the  underlying  processes 
are  known  'a  priori’  or  must  be  estimated  from  the  data. 

In  the  next  two  subsections,  we  describe  the  procedures  used  to  determine 
the  filter  orders  and  coefficients.  In  the  final  subsections,  the  Monte-Carlo 
simulation  procedures  for  detection  performance  evaluation  are  described.  The 
procedures  presented  in  this  chapter  are  illustrated  by  generating  two  channel 
vector  processes  (each  of  order  two)  using  the  method  described  in  chapter  IV. 
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7.2.  'KNOWN'  UNDERLYING  PROCESSES 

In  this  case,  it  is  assumed  that  the  models  of  the  underlying  signal,  clutter 
and  noise  processes  are  known  'a  priori’.  Since  the  signal  and  clutter  are  AR 
processes  and  the  additive  Gaussian  noise  is  white,  this  amounts  to  knowing  the 
variances  of  each  process,  as  well  as  the  orders  and  AR  coefficients  of  the  AR 

processes.  Even  so,  it  is  necessary  to  determine  the  orders  and  AR  coefficients  of 
the  AR  models  used  to  approximate  the  received  ARMA  processes  under  both  H0 

and  H,.  The  procedure  employed  to  accomplish  this  is  described  next. 

Ideally,  it  is  expected  that  the  probability  of  detection  will  monotonically 
increase  to  some  asymptotic  value  as  the  AR  orders  in  the  implementation  of 
section  6.4  are  increased,  thereby  resulting  in  better  approximations  to  the 
received  ARMA  process.  Our  procedure  given  below  is  to  successively  try 
higher  orders  until  negligible  improvements  in  detection  performance  result. 
Specifically,  we  utilize  the  following  empirical  method: 

(i)  Observation  data  processes  for  both  the  Hq  and  Hj  hypotheses  are  generated 
using  a  sufficiently  large  number  of  time  samples  NTC  and  realizations  NRC 

to  reduce  the  variance  associated  with  the  coefficient  estimates  to  an 
acceptable  level.  The  notation  TC  and  RC  are  used  to  denote  that  these  time 
samples  and  realizations  are  used  for  the  purpose  of  determining  the 
coefficients.  The  ergodicity  considerations  discussed  in  chapter  5  are  used 
to  select  appropriate  values  for  NTC  and  realizations  NRC. 

(ii)  Both  sets  of  observation  data  are  now  processed  by  the  Strand-Nuttal 

algorithm  to  obtain  an  estimate  of  the  matrix  coefficient  for  each 
realization  of  the  NTC  time  samples.  The  estimates  of  the  matrix 

coefficients  are  then  averaged  over  the  NRC  realizations.  These 
computations  are  performed  for  models  of  order  p=  2,  4,  8,  12,  16  and  20. 
In  general,  these  various  model  orders  would  be  considered  for  both 
prediction  error  filters  shown  in  Fig.6.4.1.  In  this  dissertation,  however, 

we  only  consider  the  signal  in  additive  Gaussian  white  noise  case.  Since  the 
A(k)  coefficients  for  the  H0  filter  are  null  matrices  in  this  case,  we  need 

only  consider  the  order  of  the  Hj  filter. 

(iii)  The  AR  coefficients  for  the  model  of  order  p  arc  used  to  determine  the 
coefficients  of  the  pth  order  prediction  error  filters  shown  in  Fig.6.4.1. 
The  probability  of  detection  is  evaluated  using  NT  time  samples  for  each 


case  using  the  procedure  to  be  described  in  section  7.3.  For  the  signal  in 
white  noise  problem,  the  six  cases  of  the  filters  for  orders  2,  4,  8,  12,  16 
and  20  for  the  Ht  filter  are  used  in  the  likelihood  ratio  implementation  in 

section  6.4  and  the  filter  orders  are  selected  at  the  value  for  which 
detection  performance  is  sufficiently  close  to  its  asymptotic  value. 

7.2.1.  Signal  in  Additive  White  Noise  Problem 

For  the  signal  in  white  noise  problem,  filter  coefficients  of  value  zero  are 
used  in  the  F0  filter  since  the  MMSE  coefficient  matrix  for  an  uncorrelated,  zero- 

mean  multichannel  white  noise  process  is  a  null  matrix.  For  the  Fj  filter,  we 

determine  the  filter  order  and  coefficients  using  the  empirical  method  outlined 
above.  As  a  first  example,  we  consider  a  case  with  relatively  high  temporal  and 
cross-channel  correlation.  For  this  case,  the  parameters  were  A.U=A.22=0.9, 

2  2  2  2 

lp12l=0.99  arid  S/N=+3dB  using  cSii=gS22=2  and  oWllaOw22*l*  The  specific 

values  of  NTC= 10,000  and  NRC=100  were  selected  in  our  process  synthesis 

procedure  described  in  chapter  4.  The  detection  performance  for  the  two- 
channel  signal  in  additive  white  noise  case  for  NT=*10  was  evaluated  using  the 

Monte-Carlo  procedure  to  be  described  later.  The  probability  of  detection  is 
plotted  in  Fig.7.2.1  versus  the  six  filter  orders  of  Fj  for  the  two  false  alarm 

probability  values  of  6.93xl0'2  and  6.93xl0’4.  As  noted,  for  a  filter  order 

greater  than  four,  negligible  differences  in  the  values  of  the  probability  of 
detection  were  obtained.  Even  so,  an  Fj  filter  of  order  eight  was  selected  for  the 

simulations  involving  this  case. 

We  now  consider  a  second  example  and  emphasize  the  procedure  used  to 

determine  the  filter  coefficients  and  variances  used  in  the  likelihood  ratio 

calculation.  In  this  example,  we  consider  the  signal  in  additive  white  noise  where 

2  2 

the  signal  parameters  are  aSll=Cs22=0.3  1  62,  kn=  X22  =  0.9,  lp12l  =  0.99  and 

S/N=-5dB.  The  additive  white  noise  vector  process  considered  here  is 

uncorrelated  across  channels  with  a  variance  of  unity  on  each  channel.  The  first 
step  in  this  procedure  is  to  synthesize  NRC=100  realizations  each  with 

NTC=  10,000  observation  time  samples  under  hypothesis  Hr  Figs.  7.2.2a  and 
7.2,2c  show  the  corresponding  time-averaged  autocorrelation  functions  for  each 
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Fig  7.2.1  Probability  of  detection  for  a  signal  in  additive  white 

noise  versus  transversal  prediction  error  filter  orders  for  Fj . 
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channel  of  the  synthesized  i(nlHj)  process,  while  Fig.  7.2.2e  shows  the  cross¬ 
correlation  function.  Based  on  the  results  discussed  previously,  we  approximate 
the  multichannel  ARMA  process  under  hypothesis  Ht  with  a  multichannel  AR 

process  of  order  eight.  We  now  use  the  synthesized  observation  data  generated 
under  Hj  to  estimate  these  coefficients.  These  coefficients  are  obtained  using  the 

Strand-Nuttall  estimation  algorithm  with  the  above  10,000  time  samples  for  each 

of  the  100  realizations.  We  then  average  the  coefficients  over  the  100 
realizations.  The  resulting  estimates  of  the  Ap(k)  k=l,2,...,8  matrix  coefficients 

are  the  coefficients  used  in  the  first  stage  of  the  Fj  filter  to  obtain  the  £(nlHj) 
error  vector.  The  second  stage  coefficient  used  to  decorrelate  £(nlH,)  across  the 

channels  is  then  obtained  using  a  Cholesky  decomposition  CCH  of  the  estimated 

-1 

forward  error  covariance  matrix  to  obtain  Ca  (see  chapter  6).  The  observation 
data  &(nlHj)  is  now  used  as  an  input  to  the  two  stage  filter  to  obtain  fit(nlHj)  using 
cj.  Figs. 7. 2.2b  and  7.2.2d  show  the  autocorrelation  functions  of  the  vector 

U(nlHj)  for  each  channel  in  this  example.  The  autocorrelation  functions  for  each 
channel  indicate  that  the  fl(nlHj)  processes  are  temporally  whitened,  unit  variance 
processes.  This  result  agrees  with  the  analytical  development  leading  to  the 
likelihood  ratio  expressed  by  eq(6.1.38).  The  cross-correlation  function  for  the 
two  channels  is  shown  in  Fig.  7.2.2f  and  indicates  that  the  cross-channel 
correlation  has  been  significantly  reduced.  We  note  that  the  results  in  this 
example  illustrate  the  fact  that  the  Fj  filter  of  order  eight  performs  the  desired 
whitening  of  the  observation  data  received  under  hypothesis  Hj,  when  using  the 

coefficients  estimated  with  the  large  data  base  described  above.  The  filter 
coefficients  and  error  variances  obtained  by  this  procedure  are  treated  as  the 
'known'  values  of  the  AR  process  which  in  turn  is  a  close  approximation  to  the 
true  ARMA  process. 

For  the  signal  in  white  noise  problem,  the  observation  data  under  H0  is 
totally  uncorrelated  white  noise  both  in  time  and  across  channels.  Thus,  the 
parameter  coefficients  for  this  process  are  null  matrices. 
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7.3.  Monte-Carlo  Procedure  for  the  'Known’  Underlying 
Process  Case 

In  this  section,  we  describe  the  detection  performance  evaluation  procedure 

used  once  the  filter  coefficients  and  error  variances  have  been  determined  using 
the  method  presented  in  the  previous  section.  First,  a  sequence  of  Nx  data 

samples  is  generated  for  each  realization  under  both  hypotheses.  Under  Hq,  noise 
processes  are  generated  without  the  signal  while  under  Hp  the  signal  process  is 
included.  In  the  Tcnown’  case,  we  note  that  the  value  of  NT  used  in  the  detection 
procedure  is  not  necessarily  the  value  NTC  used  to  determine  the  coefficients. 
Each  sequence  of  NT  samples  is  then  used  to  compute  a  single  value  of  the 
likelihood  ratio.  The  detection  threshold  level  Yb  is  determined  by  computing 
the  likelihood  ratio  for  NR  realizations  of  the  Hq  observation  data  where  the  NT 

data  samples  are  used  in  each  realization.  These  values  are  rank  ordered  and  a 
threshold  level  determined  to  establish  a  specified  false  alarm  probability. 
Specifically,  if  X(Hj)  is  the  random  variable  representing  the  number  of  times 

that  the  threshold  is  exceeded  under  hypothesis  Hj  i=0,l  obtained  from  NR 

independent  realizations,  then  the  probability  of  exceeding  a  threshold  can  be 
estimated  using 

a  X(Hj) 

ft  =  i  =  0,1.  (7.3.1) 

And  so,  under  hypothesis  H0,  the  estimate  of  the  false  alarm  probability  becomes 


(7.3.2) 


Similarly,  the  estimated  probability  of  detection  is  expressed  as 


(7.3.3) 


For  the  'known'  parameter  case,  detection  performance  is  computed  in 
section  7.6. 1.1  using  two-channels  (J=2)  consisting  of  NT  =  10  time  samples  plus 
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eight  additional  samples  to  pre-fill  the  F}  filter  and  NR  =  20,000  realizations  for 
the  Monte-Carlo  procedure.  The  Ft  and  F0  filter  coefficients  are  obtained  as 

discussed  in  the  previous  section. 

Motivated  by  a  discussion  in  [79],  we  next  determine  the  standard  deviation 
associated  with  the  estimated  probability  of  false  alarm,  £fa,  and  probability  of 

detection,  £d,  when  using  the  Monte-Carlo  procedure.  Let  A(Hj)  denote  the  event 
that  the  threshold  is  exceeded  under  hypothesis  Hj  i=0,l.  We  define  the 

probability  of  A(Hj)  as  PtACH^jspj  and  P[A(Hi)]=l-pi  where  A(Hj)  is  the 

complementary  event;  ie.,  the  event  that  the  threshold  was  not  exceeded.  For  i  = 
0  and  1,  p0  and  pj  are  the  probabilities  of  false  alarm  Pfa,  and  detection  Pd, 

respectively.  The  sample  space  consists  of  all  possible  sequences  [a1,a2,...,aN  }, 

where  each  aj  j=l,2,...,NR  is  either  A(Hj)  or  A(Hj)  depending  on  whether  A(Hj) 

or  A(Hj)  occurred  on  the  jth  repetition  of  £.  We  also  assume  that  P[A(Hi)]=pi 
remains  constant  for  all  repetitions.  Since  X(H,)  is  the  number  of  times  that  the 
event  A(Hj)  occurred  under  hypothesis  H(,  X(Hj)  is  a  binomial  random  variable 
with  parameters  NR  and  p4.  The  probability  that  X(Hj)  -  D  is  expressed  as 

P[X(Hj)=D]=(NDR)(pi)D(l-pi)NR-D  i=0,l  D=0,1 . Nr  (7.3.4) 

where  D  is  the  number  of  times  the  threshold  is  exceeded.  The  mean  and  variance 
of  X(Hi)  are  expressed  as 


E[X(Hj)]  *  NRpi  i-0,1 

and 

V[X(Hj)]  *  NRPi(l-Pi)  i=0,l. 


(7.3.5a) 

(7.3.5b) 


respectively.  Using  eqs(7.3.1)  and  (7.3.5),  the  mean,  variance,  and  standard 
deviation  of  f),  are  expressed  respectively  as 


E[fc]  =  E[X(Hj)/NR]  =  E(X(Hj)]/NR=  Pi  i  =  0,1  (7.3.6a) 
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and 


A  V[X(Hj)]  pid-pj) 

VIW  =  V[X(Hj)/Nr]  =  =  -1Tr-L 


Of).  =  VV(X(Hi)/NR]  =  '^Ei^ 


1  as  0,1 


i  =  0,1 


(7.3.6b) 


(7.3.6c) 


where  i=0  and  1  provide  the  appropriate  expression  for  the  probability  of  false 
alarm  and  detection,  respectively.  Eq(7.3.6a)  indicates  that  ^  expressed  in 

eq(7.3.1)  is  an  unbiased  estimate  of  pj.  From  eq(7.3.6c),  we  obtain  for  NR  the 
expression  given  by 


Nr  = 


I-  Pi] _ l 

Pi  J<«fr/Pi> 


.12 


(7.3.7) 


where  the  ratio  a^./pj  is  referred  to  as  the  'coefficient  of  variation'  [84]. 

Eq(7.3.7)  enables  us  to  determine  the  number  of  realizations  in  the  Monte-Carlo 

procedure  that  are  required  to  achieve  a  specific  value  of  this  ratio  for  the 
estimate  of  Pfa  or  Pd.  As  an  example,  under  hypothesis  H0,  we  have  from 

eq(7.3.7)  with  p0  =  Pfa 


1 


For  <J£Q/Pfa  =  0.30  and  Pfa  «  1,  we  note  that  [79] 


(7.3.8) 


Nr  =  1  1/Pfa 

while  for  O£>0/Pfa  -  0.05 


Nr  =  400/Pfa . 


(7.3.9) 


(7.3.10) 


We  can  also  use  eq(7.3.6c)  to  obtain 
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(7.3.11) 


1-P 


fa 


NbP 


Rrfa 


1 

2 


Using  NR=20,000  realizations,  the  ratio  expressed  by  eq(7.3.11)  is  2.59% 
when  Pfa=.0693,  while  for  Pfa=6. 93x10“*,  we  obtain  26.85%.  Under  hypothesis 
Hjt  we  have  p!  =  Pd.  In  this  case,  eq(7.3.6c)  can  be  used  to  determine 


°fc/pd 


1 

2 


NRPd 


(7.3.12) 


With  NR=20,000  realizations,  the  ratio  expressed  by  eq(7.3.12)  is  0.236% 
when  Pd=0.90.  The  expressions  derived  above  enable  us  to  determine  confidence 

levels  associated  with  the  detection  results.  Eqs(7.3.11)  and  (7.3.12)  are  used  in 
section  7.6  to  place  error  bars  on  the  detection  results.  In  the  case  of  processes 

with  known'  parameters,  the  standard  deviation  of  the  detection  results  are  due 
to  use  of  the  finite  number  of  realizations  NR  in  the  Monte-Carlo  procedure.  As 

we  will  now  discuss,  the  standard  deviation  of  the  detection  performance  results 
associated  with  the  case  of  'unknown'  process  parameters,  is  also  a  function  of  the 
errors  associated  with  the  estimates  of  the  parameters  of  the  observation  process 

as  will  be  discussed  in  the  next  section. 

In  the  implementation  of  the  Monte-Carlo  method  for  NR  realizations  of 

the  observation  data  with  NT  samples  in  each  realization  are  generated  under  Hq. 
This  data  is  used  to  calculate  NR  likelihood  ratios  which  are  then  rank  ordered. 
We  then  select  the  upper  cIq  values  from  the  rank  ordered  likelihood  ratios  so  that 

the  estimated  probability  of  false  alarm  can  be  calculated  as 


p 


fa  =  NR- 


(7.3.13) 


The  threshold  is  now  set  between  the  values  of  the  likelihood  ratio 
corresponding  to  the  figth  value  and  the  next  lower  value.  Thus,  dg  values  of  the 

detection  statistic  will  lie  above  the  threshold  providing  an  estimate  of  the  desired 
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false  alarm  probability.  Similarly,  Nr  independent  realizations  under  hypothesis 
Hj  are  used  to  compute  NR  likelihood  ratios  with  the  Hj  data.  The  estimated 

probability  of  detection  £d  is  now  computed  by  counting  threshold  crossings  for 
the  threshold  obtained  above. 

We  note,  however,  that  £fa  and,  therefore,  the  threshold  Yb  are  random 

variables  due  to  the  randomness  associated  with  the  Monte-Carlo  method.  We 
must,  therefore,  consider  the  effect  of  the  error  associated  with  the  estimated 
threshold  ^  on  the  probability  of  detection  Pd.  Denoting  the  standard  deviation 

of  "£b  as  cY  and  using  eq(K.1.47)  from  Appendix  K  to  obtain  Pd  for  the  model 
I(INCOH)  signal,  the  tolerance  about  Pd  can  be  expressed  as 


Pd±8=l-Ir 


Yb±°v. 


vjtt  • (N-2) 


.  i  1N-‘ 

1  +  N(S/N)avgJ 


{  expKYfcio^Vd  +  N(S/N),vg)] 
Yb±oVb 

VN^[l+l/N(S/N)avgI  •  (N‘2) 


-  1  }  (7.3.14) 


where  Ir(u,s)  is  the  incomplete  Gamma  function  defined  by  eq(K.1.44)  and  8 
denotes  the  error  tolerance  in  Pd  corresponding  to  a  shift  of  aYb  in  the  threshold 

Yb.  Similarly,  for  the  model  II(INCOH)  signal,  eq(K.2.9b)  yields 


Pd±5  = 


Yb±°y, 


VN[1+(S/N)avg]  ’ 


(N-l) 


(7.3.15) 
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7.4.  Monte-Carlo  Procedure  for  ’Unknown*  Underlying  Processes 

For  the  detection  results  presented  in  this  dissertation,  the  prime  emphasis 
is  placed  on  validation  of  the  likelihood  ratio  implementation  using  the  case  of  the 
'known'  underlying  processes.  Detection  results  for  the  case  of  'unknown' 
underlying  processes  are  not  included  here.  However,  it  is  worthwhile  to  discuss 
the  procedure  for  this  case.  For  processes  with  'unknown'  parameters,  we  make 
no  'a  priori'  assumptions  regarding  the  values  of  the  underlying  process 
parameters.  For  this  case,  the  generalized  likelihood  ratio  is  implemented  since 
we  are  estimating  these  parameters  using  the  available  observation  data. 
However,  it  is  often  assumed  that  the  model  orders  of  the  processes  and  the 
prediction  error  variances  under  each  hypothesis  are  'known'  and  could  be 
selected  using  the  procedure  described  previously. 

The  generalized  likelihood  ratio  is  usually  evaluated  using  parameter 
estimation  algorithms  based  on  time-averaging  methods.  For  the  'unknown' 
parameter  case,  particular  emphasis  is  given  to  obtaining  detection  performance 
limits  which  result  due  to  the  errors  associated  with  the  time-averaged  estimates. 
In  chapter  5,  analytic  expressions  are  derived  for  the  variance  of  the  time- 
averaged  auto-  and  cross-correlation  function  estimators  using  ergodic 
considerations  and  compared  to  computed  results.  The  results  reveal  that  the 
error  variances  associated  with  these  estimates  are  related  not  only  to  the  extent 
of  the  observation  window,  but  also  to  'fundamental  process  characteristics'  such 
as  the  temporal  and  cross-channel  correlation  as  well  as  the  variance  of  the 
processes.  Thus,  detection  performance  limits  for  a  generalized  likelihood  ratio 
using  estimation  methods  will  also  depend  directly  on  these  underlying  process 
characteristics.  In  future  analyses,  thf*  detection  results  will  be  evaluated  to 
reflect  the  errors  associated  with  the  AR  coefficient  estimates.  Specifically,  a 
confidence  bound  will  be  determined  for  each  detection  result  using  signal 
processes  containing  various  amounts  of  temporal  and  cross-channel  correlation. 

For  the  case  of  'unknown'  process  parameters,  the  detection  procedure  is 
modified  from  that  of  the  'known'  parameter  case  in  order  to  compute  the 

confidence  bounds  on  the  detection  results.  As  in  the  'known'  parameter  case,  a 
sequence  of  NT  data  samples  is  generated  under  each  hypothesis,  H0  and  Hj.  In 

this  case,  however,  the  first  set  (ie.,  one  realization)  containing  NT  observation 
data  time  samples  under  H0  is  used  to  estimate  the  coefficients  for  both  filters  F0 
and  Fj  using  their  respective  filter  orders.  As  noted  in  section  6.4,  the  order  of 
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the  filter  F0  is  lower  than  that  of  Fj  since  the  addition  of  the  signal  process 
increases  the  order  of  the  process.  Several  procedures  could  now  be  used  to 
determine  the  threshold  setting  depending  upon  the  objectives  of  the  detection 
analysis.  This  could  again  be  accomplished  using  ’a  priori’  data.  However,  a 

procedure  more  congruous  with  this  ’unknown’  parameter  case  would  be  to  use 
NRt  realizations  (which  are  independent  of  the  data  set  used  to  estimate  the 

coefficients)  to  compute  NRt  likelihood  ratios.  Again,  these  values  are  rank 

ordered  and  a  threshold  level  determined  to  establish  a  specified  false  alarm 
probability.  The  same  procedure  is  then  used  with  a  data  set  obtained  under  H  j ; 

ie.,  the  coefficients  for  both  F0  and  Fj  are  computed  using  a  single  data  set 
containing  the  signal  process.  Then,  NRd  independent  realizations  are  used  to 
compute  NRd  likelihood  ratios.  Finally  the  number  of  threshold  crossings  dj  are 
computed  to  determine  the  probability  of  detection  Pd  using  eq(7.3.3).  This  result 

represents  the  first  detection  computation  obtained  using  one  set  of  observation 
data  to  estimate  the  filter  coefficients.  This  procedure  is  repeated  for  Nd 

detection  runs  using  an  independent  realization  of  data  samples  to  estimate  the 
coefficients.  The  Nd  detections  are  then  utilized  to  determine  the  error  variance 

of  the  detection  results  due  to  the  errors  in  the  estimation  procedure.  The  results 
could  be  determined  for  processes  with  various  levels  of  temporal  and  cross- 
channel  correlation. 

7.5.  INCOHERENT  DETECTION 

As  noted  in  section  6.2,  when  no  coefficients  are  used  in  the  prediction 
error  filters  of  the  likelihood  ratio  implementation,  the  detection  results  obtained 
correspond  to  those  of  incoherent  detection;  ie.,  the  observation  data  is  processed 

without  regard  to  the  phase  associated  with  the  processes.  In  this  case,  we  simply 
perform  the  likelihood  ratio  calculation  without  whitening  the  x(nlHj)  i=0,l  data 

by  the  prediction  error  filters.  These  results  will  be  discussed  further  in  the  next 
section. 
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7.6.  DETECTION  PERFORMANCE  RESULTS  USING  MONTE- 
CARLO  SIMULATION 

7.6.1  Introduction 

In  this  section,  we  evaluate  the  performance  of  the  multichannel  detection 
scheme  using  the  likelihood  ratio  implementation  architecture  described  in  section 
6.4.  The  input  observation  data  processes  are  generated  using  the  process 
synthesis  procedure  described  in  section  4.7.  Detection  performance  results  are 
determined  not  only  as  a  function  of  channel  signal-to-noise  ratio,  but  also  in 
terms  of  the  temporal  and  cross-channel  correlation  of  the  processes.  As 
described  in  section  4.7,  these  quantities  are  parametrically  controlled  in  the 
process  synthesis  procedure.  For  example,  the  temporal  correlation  on  the  ith 
channel  is  denoted  by  the  parameter  Xjj.  As  Xjj-*0,  the  process  becomes 

uncorrelated  sample-to-sample.  On  the  other  hand,  as  Xjj-*1,  the  process 

becomes  highly  correlated  in  time.  Likewise,  the  magnitude  of  the  cross-channel 
correlation  is  denoted  by  Ip^l.  Thus,  signal  and  clutter  processes  can  be  simulated 

over  a  wide  range  of  temporal  and  cross-channel  correlation  values  using  our 
simulation  procedure.  Two  extreme  cases  occur  when  Xy*lpjjl*0  and  Xji*lpjjl*l 

for  all  i,j=l,2 . J.  In  the  former  case,  all  of  the  J  channel  processes  are 

uncorrelated  both  in  time  and  space  (ie.,  across  channels).  In  the  latter,  they  are 
highly  correlated  in  both  of  these  dimensions.  In  the  next  subsection,  we  describe 
the  characteristics  of  signal  models  as  presented  in  the  literature  and  show  their 
relationship  to  the  processes  synthesized  in  this  dissertation.  As  we  will  discuss 
below,  analytical  expressions  [13,88]  for  probability  of  detection  performance  for 
these  cases  are  available.  Furthermore,  the  analytical  expressions  can  be 
modified  for  the  two  limiting  cases  of  multichannel  process  correlation  (see 
Appendix  K  for  details).  In  subsection  7.6.4,  these  analytical  expressions  provide 
the  bounds  for  the  experimental  detection  results  considered  here. 

7.6.2  Models  of  Signal  Processes 

In  this  subsection,  we  describe  the  signal  process  models  for  a  single 
channel  representing  the  two  limiting  cases  of  temporal  correlation  which  have 
been  used  in  the  literature  [13,  72,  88]  to  obtain  analytic  detection  results.  In 
Appendix  K,  we  extend  these  results  to  the  mutichannel  case. 
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In  specific  applications  such  as  the  radar  problem,  a  transmitted  waveform 
consisting  of  NT  pulses  (called  a  pulse  train)  is  used  to  probe  the  observation 

space  for  each  scan  of  the  radar.  The  echo  returns  thus  constitute  the  observation 
processes  and  contain  a  modulation  in  terms  of  the  amplitude  and  phase  resulting 
from  the  interaction  with  the  physical  environment.  For  these  problems,  we 
distinguish  between  the  amplitude  and  phase  characteristics  of  the  transmitted 
waveform  and  those  of  the  echo  return. 

A  transmitted  waveform  with  statistically  independent  random  phases  on 
each  pulse  is  defined  as  an  incoherent  pulse  train.  In  Appendix  K,  we  considei 
the  optimum  receiver  for  this  pulse  train.  In  the  radar  problem,  such  a 
waveform  results  due  to  transmitter  phase  instabilities  and  thermal  noise.  A 
transmitted  pulse  train  which  is  assumed  to  have  an  exactly  known  phase 
relationship  pulse-to-pulse  is  defined  as  a  coherent  pulse  train.  We  distinguish, 
however,  between  the  Tcnown  coherent  pulse  train'  where  the  initial  phase  of  the 
first  pulse  is  assumed  to  be  known  and  the  ’coherent  pulse  train'  waveform  in 
which  it  is  an  unknown  and  modeled  as  a  uniformly  distributed  random  variable 
[13].  In  subsection  7.6.4,  it  is  this  latter  waveform  that  we  will  consider  for  the 
coherent  detection  results. 

In  the  radar  problem,  the  transmitted  waveform  impinges  upon  a  desired 
target  and  the  background  environment.  The  resulting  echo  return,  therefore, 
consists  of  a  signal  and  clutter  return,  respectively.  In  addition,  there  is  the 
presence  of  additive  white  noise.  The  scattering  of  electromagnetic  radiation 
from  several  scattering  centers  on  either  the  target  or  the  background  results  in 
the  superposition  of  the  echo  returns  and  is  defined  in  the  radar  terminology  as 
scintillation.  These  fluctuating  signals  introduce  a  statistical  variation  in  the 
detection  process.  The  rate  of  these  fluctuating  signals  is  dependent  upon  the 
target/clutter  dynamics  as  well  as  the  sampling  rate  or  pulse  repetition  frequency 
(prf)  of  the  radar;  ie.f  for  slow  maneuvering  targets  and/or  high  radar  prf,  the 
fluctuation  rate  is  low.  For  targets  exhibiting  high  rate  of  change  maneuvers 
and/or  radars  with  low  prf,  the  pulse-to-pulse  returns  are  more  uncorrelated. 
The  two  extreme  cases  of  signal  temporal  correlation  have  been  designated  as 
'slow'  and  'fast'  fluctuating  targets  [72].  The  'slow'  fluctuating  model  is 
characterized  as  a  process  with  total  amplitude  correlation  pulse-to-pulse  while 
the  'fast'  fluctuating  model  represents  a  totally  uncorrelated  pulse-to-pulse 
process. 
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Assuming  that  the  kth  received  pulse  is  a  narrowband  bandpass  signal  sk(t), 
it  can  be  expressed  as  [13] 

sk(t)  =  Ajj^t-T^cosfco^t-^)  +  0k(t-tk)  +  <j>k]  (7.6. 1 ) 

where  Ak  is  the  signal  amplitude  of  the  kth  pulse,  p(t)  is  a  unit  amplitude 
rectangular  gating  function  of  duration  T,  0k(t)  is  the  kth  signal  pulse  phase 
modulation,  xk  is  the  signal  echo  delay  of  the  kth  pulse,  and  <{>k  is  the  initial  phase 
of  the  kth  pulse.  For  a  given  pulse,  we  can  set  tk  equal  to  zero  without  loss  of 

generality,  so  that  eq(7.6.1)  becomes 


sk(t)  =  Akp(t)cos[coct  +  0k(t)  +  <)>k].  (7.6.2) 

Eq(7.6.2)  can  also  be  written  as 

sk(t)  =  Re{'5k(t)exp[j(toct)]  ]  (7.6.3a) 

=  Re  { [SQc(t)  +  jsQk(t)]expO(toct) }  (7.6.3b) 

=  sIk(t)cos(coct)  -  sQk(t)sin(coct)  (7.6.3c) 

where 

8^(0  =  Akcos[0k(t)  +  <|>k]  (7.6.4a) 

sQk(t)  =  Aksin[0k(t)  +  0k]  (7.6.4b) 


and  the  symbol  ~  is  used  in  this  section  to  denote  the  complex  form.  We  also  note 
that  the  amplitude  Ak  can  be  expressed  as 


Ak  =  sjk  +  SQk  .  (7.6.5) 

For  narrowband  processes,  the  quadrature  components  slk(t)  and  sQk(t)  are 
uncorrelated  [3].  In  the  special  case  where  these  quantities  are  zero-mean 
bivariate  Gaussian  processes,  they  are  also  statistically  independent.  It  can  be 
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shown  that  Ak  and  <|>k  are  statistically  independent  random  variables  where  Ak  is 
Rayleigh  distributed  and  <J>k  is  uniformly  distributed.  We  now  designate  model 
I(INCOH)  as  the  signal  model  where  all  amplitudes  Ak  k=l,2,...,NT  in  a  pulse 

train  arc  equal  but  vary  randomly  from  pulse-train  to  pulse-train  according  to  the 
Rayleigh  distribution  and  the  initial  phase  <f>k  of  the  kth  pulse  is  a  statistically 

independent,  uniformly  distributed  i*andom  variable.  This  model  is  used  to 
describe  the  case  where  the  p>ase  of  the  echo  returns  are  randomized  due  to 
phase  instabilities  associated  with  the  transmitted  waveform.  We  designate  model 
H(INCOH)  as  the  signal  mode*  where  both  the  amplitudes  and  phases  of  the  echo 
pulses  are  statistically  independent  random  variables  with  Rayleigh  and  uniform 
distributions,  respectively.  Model  II(INCOH),  therefore,  represents  a  signal  with 
totally  uncorrelated  amplitude  and  phase  pulse-to-pulse  on  each  realization.  And 
so,  models  I(INCOH)  and  model  II(INCOH)  provide  the  two  extremes  on  the 
amplitude  correlation  of  the  processes. 

Finally,  for  a  coherent  transmitted  pulse  train,  we  define  the  model  I(COH) 
as  the  signal  model  where  the  amplitudes  over  the  entire  pulse  train  are  totally 
correlated  random  variables  as  are  the  initial  phases.  However,  they  are 
uncorrelated  between  pulse  trains  with  Rayleigh  and  uniform  distributions, 
respectively.  A  summary  of  these  models  is  shown  in  Table  7.1. 

In  the  process  synthesis  procedure,  the  temporal  correlation  of  the  ith 
channel  process  is  controlled  by  the  temporal  correlation  coefficient  For 

approaching  zero  or  unity,  both  the  real  and  imaginary  amplitudes  become  either 
uncorrelated  or  correlated  in  time,  respectively.  Since  the  phase  of  the  process  is 

related  to  the  ratio  of  these  amplitudes  through  the  inverse  tangent,  as  expressed 
by  eq(4.7.1.1),  also  controls  the  pulse-to-pulse  phase  correlation.  Thus,  for 

we  approach  model  II(INCOH),  while  for  Ajj->1,  we  approach  model 

I(COH). 

In  the  next  subsection,  we  consider  the  equivalence  between  the  signal-to- 
noise  ratio  defined  in  the  literature  in  conjunction  with  the  analytical  detection 
expressions  that  are  used  in  this  dissertation. 
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Model  IONCOH) 

Model  I(COH) 

Model  n(INCOH) 

Amplitude  PDF 

Rayleigh 

Rayleigh 

Rayleigh 

Initial  Phase  PDF 

uniform 

uniform 

uniform 

pulse-to-pulse 

amplitude 

correlated 
slow  fluctuation 

correlated 
slow  fluctuation 

uncorrelated 
fast  fluctuation 

pulse-to-pulse 

phase 

uncorrelated 
(uniform  distr) 

totally 

correlated 

uncorrelated 
(uniform  distr) 

4>1  of 
pulse  train 

random 

random 

random 

correlation 
between 
pulse  trains 

uncorrelated 

uncorrelated 

uncorrelated 

Table  7.1  Summary  of  Signal  Model  Characteristics 
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7.6.3  Signal-to-Noise  Ratio 

We  now  relate  the  signal-to-noise  ratio  defined  in  the  literature  [13,88]  for 
the  analytical  detection  curves  used  in  the  next  subsection  and  that  defined  in 
subsection  4.3.2  for  the  baseband  processes.  Dropping  the  subscript  k  in 
eq(7.6.2),  we  consider  the  bandpass  sinusoidal  signal  with  random  amplitude  A 
expressed  as 

s(t)  =  Ap(t)cos[toct  +  0(t)  +  $].  (7.6.6) 


The  signal  energy  Ep  in  the  pulse  of  duration  T  is  defined  as 
T 

Ep  =  J  s2(t)  dt 


«  A2  J  cos2[o)ct  +  0(t)  +  <j)]dt 
0 

A2  T 

=  -y-  J  { 1  +  cos[2o)ct  +  20(t)  4-  2<j>] }  dt 
0 


(7.6.7a) 

(7.6.7b) 

(7.6.7c) 


A2  7  A2  7 

—  J  dt  +  J  cos[2coct  +  20(t)  +  26]dt. 
Z  0  0 


(7.6.7d) 


Since  the  function  0(t)  is  slowly  varying  and  is  a  constant  and  the 
contribution  from  the  double  frequency  term  is  recognized  to  be  negligible  with 
respect  to  that  from  the  DC  term,  eq(7.6.7d)  reduces  to 


A2T 

2 


(7.6.8) 


The  single  pulse  power  signal-to-noise  ratio,  commonly  used  in  the  literature,  is 
expressed  as  [72,74] 
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where 


(S/N)p  a  ^ 


_Jk 

'P  *  Nq/2  • 


(7.6.9) 

(7.6.10) 


Using  eq(7.6.8b)  and  the  definition  of  the  signal-to-noise  ratio  Rp  in  eq(7.6.9), 
we  obtain 


1 

(S/N)p»’2E»2 


\  a2t 


LNq/2 


1  a  2 

2  A  _  avg  power  of  signal  during  duration  T 
NqB  ”  avg  noise  power  in  bandwidth  B 


(7.6.11a) 

(7.6.11b) 


where  the  filter  bandwidth  B  *  1/T.  Averaging  eq(7.6.11b)  with  respect  to  A, 
we  obtain 


(S/N) 


_**T> 
nvg-  2 


2  E[A2] 

NoB 


(7.6.12) 


We  now  consider  the  signal-to-noise  ratio  for  the  baseband  processes.  We 
2 

define  the  variance  as  of  the  sampled  complex  baseband  signal  process  as 


a,  ■  E[s(n)s*(n)]  (7.6.13a) 

-  E(sf(n)J  +  E[Sg(n)].  (7.6.13b) 

Using  eqs(7.6.4)  in  (7.6.13b)  with  the  subscript  k  dropped, 

oj*  E[A2]cos2(6(nTs)  +  <J>]  +  E[A2]sin2[0(nTs)  +  <J>]  (7.6.14a) 

=  E(A2]  (7.6.14b) 
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where  Ts  is  the  time  duration  between  samples  (ie.,  pulses).  For  the  noise 
variance  we  have 


Ow  =  E[w(n)w*(n)j 
=  E[wJ(n)]  +  E[wg(n)3 
2  2 

=  Owj  +  OwQ. 


(7.6.15a) 

(7.6.15b) 

(7.6.15c) 


For  an  ideal  bandpass  filter  of  bandwidth  B,  the  autocorrelation  function  of 
the  noise  quadrature  components  can  be  shown  to  be 


Rw,(D  s  R  wQ0)  =  NoBsinc(BI) 
so  that  at  1=0,  we  have 


(7.6.16) 


and 


<*wj =  RWl(0)  =  NqB 


OwQ  =  RWq(0)  «  N0B. 


(7.6.17a) 


(7.6.17b) 


Using  eqs(7.6.17)  in  eq(7.6.15c),  we  have 
2 

ojr  =  2NqB. 

Finally,  using  eq(7.6.14b)  and  (7.6.18),  we  obtain 

/c/vtn  2,  2  E[A21 

(S/N)  s  Gj/Ow  =  2NqB 

$E[A2] 

=  NqB  • 


(7.6.18) 


(7.6.19a) 


(7.6.19b) 


We  note  that  eqs(7.6.12)  and  (7.6.19b)  are  identical.  In  subsection  7.6.4, 
the  synthesized  processes  used  as  inputs  to  the  detection  architecture  have  a 
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signal-to-noise  ratio  as  defined  by  eq(7.6.19a).  The  analytic  detection  curves  to 
which  these  results  are  compared  have  a  signal-to-noise  ratio  defined  by 
eq(7.6.12).  As  discussed  here,  the  two  definitions  are  equivalent. 

We  now  consider  the  case  of  a  coherent  pulse  train  that  is  exactly  known 
except  for  (j^;  ie.,  the  phase  relations  between  pulses  in  the  train  are  assumed  to 

be  known  exactly,  but  <t»1  on  each  train  is  unknown.  This  condition  is  met  for  the 

model  I(COH)  process.  We  again  note  that  in  the  process  synthesis  procedure 
described  in  section  4.7,  it  is  this  case  which  is  approached  as  the  temporal 
correlation  is  increased. 

The  signal-to-noise  ratio  for  the  case  where  NT  pulses  are  coherently 
integrated  can  be  obtained  as  follows.  We  first  note  that  the  signal-to-noise  ratio 

defined  above  is  that  for  single-pulse  detection.  Let  us  denote  this  ratio  for 
channel  j  as  (S/N)j  j  where  the  subscript  j  indicates  the  channel  and  the  1  indicates 

single  pulse.  The  effective  signal-to-noise  ratio  for  an  ideal  coherent  multiple 
pulse  system  on  channel  j  using  NT  pulses  is  [88,89] 

(S/N)j,NT  =  NT  (S/N)j  j  (7.6.20) 

where  NT  is  the  number  of  pulses  coherently  integrated.  -This  equation  will  be 
used  in  the  next  subsection  to  determine  the  model  I(COH)  detection  curve. 

7.6.4.  Signal  Detection  in  Additive  White  Noise 

In  this  section,  detection  results  are  computed  using  the  Monte-Carlo 

procedure  and  compared  to  available  analytical  detection  curves  for  the  models 

described  in  section  7.6.2.  Two-channel  (J=2)  complex  baseband  correlated 

Gaussian  signal  vectors  are  synthesized  and  added  to  a  complex  Gaussian  white 

noise  vector.  The  noise  vector  consists  of  uncorrelated  channel  processes  unless 

specifically  stated.  All  signal  processes  are  autoregressive  AR(2)  with  order  two. 

The  parameters  for  the  signal  processes  used  in  this  section  are  listed  in  Table 

7.6.1.  These  observation  data  processes  are  used  as  an  input  to  the  likelihood 

implementation  architecture  described  in  section  6.4  using  the  Choleeky 

H 

decomposition  CaCa  in  the  second  filtering  stage  (see  Fig.6.4.2).  The  prediction 
error  filter  coefficients  for  the  tapped  delay  line  filter  Fj  are  determined  from 
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the  Hj  hypothesis  data  as  described  in  section  7.2.1  using  the  forward  coefficients 

from  the  Strand-Nuttal  algorithm^,  ie.,  for  the  'known'  parameter  case,  a  large 
number  of  data  samples  is  used  to  determine  the  prediction  error  filter 

coefficients  in  an  'a  priori’  manner.  As  noted  in  section  7.2.1,  the  order  of  the 
Fj  filter  used  in  these  analyses  was  eight;  ie.,  the  matrices  Ap(k)  for  k=l,2,...,8 
-1 

and  CQ  are  used.  Since  the  hypothesis  Hq  data  consists  of  uncorrelated  white 

noise,  the  MMSE  coefficient  matrix  for  this  process  is  a  null  matrix.  Therefore, 
Ap(k)  for  the  F0  filter  is  a  null  matrix  coefficient  and  the  second  stage  coefficient 

matrix  is  an  identity  matrix. 

For  the  signal  parameters  listed  in  section  A  of  Table  7.6.1,  the  computed 
detection  results  are  plotted  in  Figs.  7.6.1  and  7.6.2  for  probability  of  false  alarm 
levels  of  0.0693  and  6.93x1 0*4,  respectively.  We  note  that  these  false  alarm 
values  were  selected  using  Fehlner  numbers  n'=10  and  1000,  respectively,  where 
Pfa=ln2/n'  [88].  These  detection  results  were  computed  with  J=2  channels,  N^IO 

observation  samples,  and  equal  signal-to-noise  ratios  on  each  channel;  ie., 
(S/N)=(S/N)j=(S/N)2.  The  Monte-Carlo  procedure  used  NR=20,000  realizations 

as  discussed  in  section  7.3.  We  also  plot  the  analytical  probability  of  detection 
curves  from  Meyer  and  Mayer  [88]  for  the  case  i(INCOH),  casel(COH)  and  case 
n(INCOH)  signals  described  in  section  7.6.2.  The  model  I(COH)  detection  curve 
for  the  coherent  integration  of  NT  pulses  is  determined  using  the  detection  curves 

[88]  for  (S/N)jiN<r  rather  than  (S/N)jtl  as  discussed  at  the  end  of  section  7.6.3.  In 

Appendix  K,  these  curves  are  shown  to  provide  bounds  on  the  detection  results 
presented  here  using  JNj=20. 

Examination  of  Figs.  7.6.1  and  7.6.2  reveals  that  the  analytical  detection 
curves  in  each  of  these  two  figures  have  a  point  at  which  the  curves  intersect. 
For  example,  in  Fig.  7.6.1,  the  model  I(COH)  and  model  II(INCOH)  curves 
intersect  at  S/N=  -ldB.  We  have  purposely  selected  processes  with  S/N  values 
above  and  below  these  intersection  points  in  order  to  investigate  the  effect  of  the 
temporal  and  cross-channel  correlation  on  detection  performance  in  both  regions. 
We  anticipate  that  processes  uncorrelated  both  temporally  and  across  channels 
will  lie  closer  to  the  model  II(INCOH)  bound  while  those  with  high  correlation 
will  lie  closer  to  the  model  I(COH)  bound. 

*  The  software  for  the  Strand-Nuttal  algorithm  is  available  in  [17]  and  was  used  here. 
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section 

case 

^11 

hi 

'Pl2> 
a,  b,  c 

(S/N)j 

(S/N)2 

A 

■w 

0.1 

0.1 

0,0.5,0.99 

-5dB 

-5dB 

m 

0.9 

0.9 

0,0.5,0.99 

-5dB 

-5dB 

0.1 

0.1 

0,0.5,0.99 

+3dB 

+3dB 

ns 

0.9 

0.9 

0,0.5,0.99 

+3dB 

+3dB 

0.999 

0.999 

0,0.5,0.99 

+3dB 

+3dB 

B 

0.1 

0.1 

0,0.5,0.99 

+3dB 

+3dB 

WttBM 

0.1 

0.1 

0,0.5,0.99 

+3dB 

OdB 

8  a,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-3dB 

9  a,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-6dB 

10a,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-9dB 

1  la,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-20dB 

12a,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-3  OdB 

13a,b,c 

0.1 

0.1 

0,0.5,0.99 

+3dB 

-40dB 

14a,b,c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

+3dB 

15a, b.c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

OdB 

16a,b,c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-3dB 

17a,b,c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-6dB 

18a,b,c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-9dB 

19a, b.c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-20dB 

20a, b.c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-3  OdB 

21a,b,c 

0.9 

0.9 

0,0.5,0.99 

+3dB 

-40dB 

wmM 

0.999 

0,0.5,0.99 

+3dB 

+3dB 

wm 

0.999 

0.999 

0,0.5,0.99 

+3dB 

OdB 

24a,b,c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-3dB 

25a, b.c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-6dB 

26a,b,c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-9dB 

27a, b,c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-20dB 

28a,b,c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-3  OdB 

29a, b.c 

0.999 

0.999 

0,0.5,0.99 

+3dB 

-40dB 

Table  7.6.1  The  AR(2)  Signal  Parameters  used  in  the  detection  analyses. 
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pd 


Fig.  7.6.1  Probability  of  detection  versus  S/N  for  a  Gaussian  signal  plus  Gaussian 
white  noise  'with'  Fj  filter  coefficients;  S/N=(S/N)1=(S/N)2, 

Pfa=0.0693,  N=10,  J=2. 
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n(INCOH) 


ai 


I(INCOH)  — » 


Pfa=  6.93xl0‘4  * 

Np=  10 

J  =  2  l 


-5  -3  -1  +1  +3  +5  +7  +9 

S/N 


Fig.  7.6.2  Probability  of  detection  versus  S/N  for  a  Gaussian  signal  plus  Gaussian 
white  noise  ’with'  F!  filter  coefficients;  S/N=(S/N)!=(S/N)2, 

Pfa=6.93xl04,  N*  10,  J=2. 


T 


In  Appendix  K,  we  show  that  the  analytical  detection  performance  curves 
associated  with  the  models  described  in  subsection  7.6.2  for  the  single  channel 

case  can  be  extended  to  obtain  bounds  on  the  detection  results  for  multichannel 
detection.  Specifically,  if  the  number  of  pulses  NT  is  replaced  with  JNT,  the 

resulting  detection  curves  describe  the  limiting  cases  of  either  totally  correlated 

or  uncorrelated  processes  in  both  time  and  space  (ie.,  across  channels).  For 
example,  with  J=2  and  N^IO,  the  analytical  detection  curves  for  20  pulses  can  be 
used  for  the  limiting  cases  of  correlation  denoted  for  Xij=lp12l=0  and  X^=lp12l=l. 

Finally,  we  note  in  Appendix  K  that  these  analytic  curves  are  approximate  for  the 
low  signal-to-noise  ratio  case. 

In  Table  7.6.1,  signal  cases  la  and  3a  have  temporal  correlation 
coefficients  A.^A^-O.l  and  cross-correlation  coefficient  magnitude  lp12l=0.0. 

These  cases  therefore  approximate  the  model  II(INCOH)  signal  model.  At  the 
other  extreme,  cases  2c  and  5c  for  which  Xn=X.22=0.999  and  lp12l=0.99 

approximate  the  model  I(COH)  signal  model.  As  shown  in  Fig.  7.6.1  for 
Pfa=0.0693,  Pd  for  cases  la  and  3a  lie  closest  to  the  model  II(INCOH)  curve  at 
S/N  values  of  -5dB  and  +3dB,  respectively.  On  the  other  hand,  Pd  for  cases  2c 

and  5c  lie  closer  to  the  model  I(COH)  curve.  Consistent  with  the  cross-over  of 
the  analytic  curves,  note  that  the  relative  detection  performance  has  reversed  for 
these  cases;  ie.,  for  the  low  S/N  value  of  -5dB,  the  more  highly  correlated  process 
of  case  2c  has  a  higher  Pd  than  the  uncorrelated  process  of  case  la.  Whereas  at 

the  higher  S/N  value  of  +3dB,  the  more  highly  correlated  process  of  case  5c  has  a 
lower  Pd  than  the  corresponding  process  of  case  3a.  W’e  also  note  that  the  case 

corresponding  to  processes  with  intermediate  correlations,  lie  at  Pd  values 

commensurate  with  their  correlation  values.  The  results  when  Pfa=6.93xl0*4  are 

shown  in  Fig.  7.6.2.  The  plotted  values  in  both  of  these  Figures  are  tabulated  in 
Table  7.6.2  including  the  sample  standard  deviation  an.j  computed  using  four 

independent  detection  trials. 

We  again  call  attention  to  the  the  fact  that  cases  la  and  3a  approximate  the 
model  II(INCOH)  signal  while  cases  2c  and  5c  approximate  model  I(COH)  signal. 
We  now  consider  the  effect  of  not  utilizing  the  phase  information  contained  in  the 
detection  scheme  for  these  processes.  Since  the  pulse-to-pulse  phase  for  the 
model  n(INCOH)  signal  is  uniformly  distributed  over  zero  to  2 n  radians,  phase 
sensitive  detection  provides  no  improvement  in  performance.  Alternatively,  the 
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0.1 
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0.9 
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0.9 

0.9 

0.9 

0.999 

0.999 

0.999 

0.999 

0.999 

0.999 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 

0.0 

0.5 

0.99 


S/N 


-5dB 

-5dB 

-5dB 

-5dB 

-5dB 

-5dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

-5dB 

-5dB 

-5dB 

-5dB 

-5dB 

-5dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 

+3dB 


0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
6.93x1c4 
6.93x1  O'4 
6.93xl0'4 
6.93x1  O'4 
6.93x1  O'4 
6.93x1  O*4 
6.93xl0'4 
6.93x1  O'4 
6.93x1  O*4 
6.93x1  O*4 
^.93xl0*4 
6.93x1  O*4 
6.93x1 0*4 
6.93x1  O'4 
6.93x1  O'4 


.430 
.464 
.555 
.687 
0.691 
0.712 
.999 
.999 
.998 
.996 
.995 
0.989 
0.981 
0.977 
0.938 
0.046 
0.063 
0.098 
0.244 
0.260 
0.319 
0.970 
0.968 
0.981 

.966 
.959 
0.942 
0.931 
0.921 
0.847 


±0.006 


±0.005 


±0.001 

±0.0003 


±0.0006 


±0.001 

±0.003 

±0.024 


±0.003 

±0.001 


±0.002 


±0.001 


Table  7.6.2  Tabulated  Detection  Results  for  Figs  7.6.1  and  7.6.2. 


effect  of  not  utilizing  the  phase  in  the  detection  scheme  causes  no  degradation  in 
performance.  On  the  other  hand,  the  model  I(COH)  signal  contains  total  pulse- 
to-pulse  phase  correlation.  In  this  case,  the  effect  of  not  utilizing  the  phase  in  the 
detection  scheme  causes  the  detection  performance  to  degrade  to  that  of  the  model 
I(INCOH)  signal.  Finally,  we  note  that  the  processing  method  which  does  not 
utilize  the  pulse -to-pulse  phase  is  the  'incoherent'  integration  method.  The 
detection  results  for  the  special  case  when  the  filter  coefficients  are  not  utilized  in 
F0  and  Fj  filters  correspond  to  those  of  'incoherent'  pulse  integration. 

Alternatively,  when  the  coefficients  are  utilized  in  the  prediction  error  filters,  the 
detection  results  correspond  to  chose  of  'coherent'  pulse  integration. 

In  order  to  compare  detection  performance  for  incoherent  integration  to 
that  of  coherent  integration,  the  filter  coefficients  of  the  prediction  error  filters 

F0  and  F1  are  disabled;  ie.,  the  Ap(k)  coefficients  are  set  to  null  matrices  and  Ca 

is  set  to  an  identity  matrix  allowing  the  observation  data  to  pass  through  the 
filters  unaltered.  The  detection  results  for  this  case  are  shown  in  Figs.  7.6.3  and 
7.6.4  for  Pfa-0.0693  and  6.93xl0*4,  respectively.  We  note  that  the  computed 

detection  results  now  range  between  the  model  I(INCOH)  and  model  II(INCOH) 
curves  as  noted  above.  At  -5dB,  a  comparison  of  these  two  figures  again 
indicates  a  reversal  in  the  detection  performance  as  a  function  of  the  temporal 
and  cross-channel  correlation.  This  result  is  consistent  with  the  fact  that  at 

pfa“6  .93xl0‘4,  the  uncorrelated  signal  model  described  by  the  model  II(INCOH) 
curve  falls  below  the  model  I(INCOH)  curve,  while  for  Pfa=0.0693,  it  lies  above 

it.  The  results  are  also  displayed  in  Table  7.6.3. 

From  the  results  presented  in  these  figures,  we  conclude  for  the  case  of 
’known’  coefficients  that  the  detection  results  computed  using  the  likelihood  ratio 
implementation  described  in  section  6.4  are  bounded  by  the  analytic  detection 
curves  [88].  Second,  the  detection  performance  of  the  processes  at  a  specific 
signal-to-noise  ratio  is  shown  to  be  a  function  of  both  the  temporal  and  cross- 
channel  correlation.  Furthermore,  this  functional  dependence  varies  with  signal- 
to-noise  ratio  and  is  consistent  with  the  cross-over  point  in  the  analytic  curves. 
We  will  discuss  the  significance  of  this  result  in  the  conclusions  under  section  8.1. 

Again,  we  note  that  the  detection  results  for  the  special  case  when  the  filter 
coefficients  are  not  utilized  in  F0  and  Fj  correspond  to  those  of  'incoherent'  pulse 
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Fig.  7.6.3  Probability  of  detection  versus  S/N  for  the  Gaussian  signal  plus 
Gaussian  white  noise  ’without’  F1  filter  coefficients; 

S/N=(S/N),=(S/N)2,  Pfa=0.0693,  N=10,  J=2. 


-5  -3  *1  +1  +3  +5  +7  +9 

SI N 


Fig.  7.6.4  Probability  of  detection  versus  S/N  for  the  Gaussian  signal  plus 
Gaussian  white  noise  'without'  Fj  filter  coefficients; 

S/N*(S/N)j«(S/N)2,  Pfa«6.93xl04,  N=10,  J=2. 
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0.1 

0.0 

+3dB 

0.0693 

0.998 

3b 

0.1 

0.1 

0.5 

+3dB 

0.0693 

0.998 

3c 

0.1 

0.1 

0.99 

+3dB 

0.0693 

0.995 

4a 

0.9 

0.9 

0.0 

+3dB 

0.0693 

0.989 

4b 

0.9 

0.9 

0.5 

+3dB 

0.0693 

0.983 

4c 

0.9 

0.9 

0.99 

+3dB 

0.0693 

0.955 

5a 

EtH 

0.0 

+3dB 

0.0693 

0.932 

5c 

Kggl 

0.99 

+3dB 

0.0693 

0.841 

la 

0.1 

0.1 

0.0 

+3dB 

6.93X10"4 

0.049 

lb 

0.1 

0.1 

0.5 

-5dB 

6.93x10“ 

0.050 

lc 

0.1 

0.1 

0.99 

-5dB 

6.93x1 0*4 

0.054 

2a 

0.9 

0.9 

0.0 

-5dB 

6.93x1 0*4 

0.058 

2b 

0.9 

0.9 

0.5 

-5dB 

6.93xl0‘4 

0.061 

2c 

0.9 

0.9 

0.99 

-5dB 

6.93x1  O'4 

0.069 

3a 

0.1 

0.1 

0.0 

-5dB 

6.93x10“ 

0.971 

3b 

0.1 

0.1 

0.5 

+3dB 

6.93x1  O'4 

0.965 

3c 

0.1 

0.1 

0.99 

+3dB 

6.93xl0‘4 

0.940 

4a 

0.9 

0.9 

0.0 

+3dB 

6.93x1 0*4 

0.902 

4b 

0.9 

0.9 

0.5 

+3dB 

6.93xl0'4 

0.882 

4c 

0.9 

0.9 

0.99 

+3dB 

6.93x1  O'4 

0.821 

5a 

0.999 

0.999 

0.0 

+3dB 

6.93x1 0*4 

0.761 

5c 

0.999 

0.999 

0.99 

+3dB 

6.93x1 0*4 

0.654 

Table  7.6.3  Tabulated  Detection  Results  for  Figs.  7.6.3  and  7.6.4, 
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integration.  Alternatively,  when  the  coefficients  are  utilized  in  the  prediction 
error  filters,  the  detection  results  correspond  to  those  of  'coherent'  pulse 
integration. 

Previously,  we  considered  the  situation  in  which  S/N  was  the  same  on  both 
channels.  We  now  extend  the  investigation  to  consider  the  situation  in  which  S/N 
remains  the  same  on  one  channel  but  is  lowered  on  the  other  channel.  In  this 

case,  the  overall  detection  performance  will  degrade  from  the  previous  cases. 

In  the  simulation  results  that  follow,  (S/N)j  was  held  fixed  at  +3dB  while 
(S/N)2  was  varied  from  +3dB  to  values  ranging  as  low  as  -40dB.  In  each  case, 
two  channels  each  with  ten  observations  were  considered  (ie.,  J=2  and  N-pslO). 

Again,  we  note  that  no  cross-channel  correlation  is  considered  on  the  noise 
processes.  The  coherent  detection  results  obtained  'with'  the  filter  coefficients 
are  shown  in  Fig.  7.6.5  and  7.6.6  for  Pfa=0.0693  and  6.93xl0'4,  respectively,  and 
^11*^22*0.1.  The  values  are  also  displayed  for  signal  cross-channel  correlation 
coefficients  Ip  0.5,  and  0.99.  We  also  show  the  Pd  value  for  channel  1 
alone  using  NT=10.  This  last  result  provides  the  basis  for  a  comparison  between 
the  two-channel  detection  results  using  (S/N)2  <  (S/N)j  and  the  results  obtained 

with  channel  1  alone.  The  tabulated  results  are  displayed  in  Table  7.6.4.  Again, 
the  sample  standard  deviations  were  computed  with  four  independent  trials.  In 
Table  7.6.5,  we  focus  our  attention  on  cases  6a  and  13a.  We  note  that  these 
processes  have  iow  temporal  correlation  and  no  cross-channel  correlation. 
Therefore,  they  closely  approximate  the  model  II  (INCOH)  process.  We  note 

that  the  single  channel  values  are  in  excellent  agreement  with  their  corresponding 
analytical  values.  The  detection  results  for  case  6a  with  (S/N)1=(S/N)2=+3dB  are 

also  in  excellent  agreement  with  the  analytic  values.  Finally,  the  case  13a 
process  with  (S/N)1=+3dB  and  (S/N)2=-40dB  is  nearly  equal  to  that  of  the  single 
channel  case  for  which  (S/N)j=+3dB  and  N^IO.  These  results  indicate  that  the 

two-channel  case  shows  improved  detection  performance  over  that  of  the  channel 
1  case  alone.  Furthermore,  as  (S/N)2  decreases,  the  two-channel  detection  results 

for  these  cases  approach  that  of  channel  1  alone. 

For  ?iu=A,22=0.9,  the  corresponding  detection  results  are  shown  in  Figs. 

7.6.7  and  7.6.8  for  PfaM).0693  and  6.93xl0'4,  respectively.  The  plotted  values  in 

both  of  these  figures  are  tabulated  in  Table  7.6.6.  It  is  interesting  to  note  that  a 
cross-over  in  the  detection  curves  occurs  in  each  figure,  but  is  slightly  more 
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Figure  7.6.5  Probability  of  detection  results  as  a  function  of  (S/N)2  and  lp12l 
for  Pfa=  0.0693,  (S/N)1=+3dB  and  X11=X22=01* 


-50  -40  -30  -20  -10  0  10 

(S/N  )2 


Figure  7.6.6  Probability  of  detection  results  as  a  function  of  (S/N)2  and  lpj2l 
for  Pfa=  6.93X10*4,  (S/N)1=+3dB  and  X^^O.l. 
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(S/N>2 


+3dB 

OdB 

-3dB 

-6dB 

-9dB 

-20dB 

-30dB 

-40dB 


+3dB 

OdB 

-3dB 

-6dB 

-9dB 

-20dB 

-30dB 

-40dB 


a 


0.999 

0.993 

0.980 

0.972±0.00l 

0.968±0.001 

0.96710.001 

0.968±0.001 

0.968±0.001 


0.76±0.02 

0.74±0.02 

0.74±0.01 

0.72±0.01 

0.7410.01 


Pd 


Ipl2l=0.5 


0.992 

0.981±0.002 

0.974±0.001 

0.972±0.003 

0.967±0.001 

0.967±0.001 

0.967±0.001 


0.968 

0.887 

0.80±0.02 

0.78±0.02 

0.77±0.03 

0.76±0.03 

0.73±0.02 

0.7310.01 


Ipj2l=0.99 


0.999 

0.994 

0.987 

0.979 

0.974 

0.96810.01 

0.96810.001 

0.96710.001 


967 
933 
862 
0.815 
0.783 
0.7510.02 
0.7410.02 
0.7510.03 


1 

I 


.0693 
.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 


6.93x10" 

6.93x10" 

6.93x10" 

6.93x10" 

6.93x10" 

6.93x10" 

6.93x10" 

6.93x10" 


Tabic  7.6.4  Probability  of  detection  results  as  a  function  of  (S/N)2  and  lp12l  for 


(S/N)j  |  (S/N)2 1  Pd  (experimental) 


X=0.1 


6a 

10 

2 

+3dB 

channel  1 

10 

1 

+3dB 

13a 

10 

2 

+3dB 

6a 

10 

2 

+3dB 

channel  1 

10 

1 

+3dB 

13a 

10 

2 

+3dB 

Pjj  (analytical) 


model  DONCOH) 


0.999 


0.968 


0.999 


0.968  10.001 


0.968  1  0.001 


0.971  0.971 


0.74  1  0.04  0.740 


0.74  1 0.01 


Table  7.6.5  Probability  of  detection  for  Xj  l  and  lp12l»0.0  with  corresponding  analytical 

results  for  the  model  Il(INCOH)  process. 


0.0693 


0.0693 


0.0693 


6.93x1c4 


6.93X10*4 


6.93x1c4 
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Figure  7.6J  Probability  of  detection  results  as  a  function  of  (S/N)2  and  lp12l  for 
Pfa=0.0693,  (S/N)1=+3dB  and  Xl  js^O.9. 


Figure  7.6.8  Probability  of  detection  results  as  a  function  of  (S/N)2  and  Ip  121  for 
Pfa“6.93xl0*4,  (S/N)1=+3dB  and  Xn=^22=0.9. 
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(S/N)2 


+3dB 

OdB 

-3dB 

-6dB 

-9dB 

-20dB 

-3CdB 


+3dB 

OdB 

-3dB 

-6dB 

-9dB 

-20dB 

-3  OdB 


a 


Ipi2l=0 


0.996 

0.990 

0.977 

0.962 

0.954 

0.948 

0.948±  0.004 


0.966 

0.915 

0.847 

0.810 

0.793 

0.788 

0.788±  0.005 


IPl2|s*°*5 


0.995 

0.987 

0.974 

0.961 

0.953 

0.948±  0.002 
0.948±  0.001 


0.959 

0.909 

0.851 

0.818 

0.788 

0.785±  0.002 
0.786±  0.003 


Ip  121=0.99 


C.958 

0.954 

0.948±0.002 

0.948 


0.941 

0.895 


0.822 
0.806 

0.792±0.007 
0.788±  0.008 


.0693 
.0693 
0.0693 
0.0693 
0.0693 
0.0693 
0.0693 


6.93x10" 
6.93x1  O'* 
6.93x10" 
6.93x10" 
6.93x10" 
6.93x10" 
6.93x10" 


Table  7.6.6a  Probability  of  detection  results  as  a  function  of  (S/N)2  and  lp12l  for 
Nt  =10,  J=2,(S/N)j=+3dB  and  \u^2=0.9. 


channel  1 

10 

1 

+3dB 

20a 

10 

2 

+3dB 

channel  1 

10 

1 

+3dB 

20a 

10 

2 

+3dB 

j  (S/N)!  |  (S/N)2  P<i  (experimental) 


X=0.9 


0.943  ±  0.007 


-30dB  I  0.948  ±  0.004 


0.787  ±0.016 


-30dB  0.788  ±  0.005 


0.0693 


0.0693 


6.93x1 0*4 


6.93x1  O'4 


Table  7.6.6b  Probability  of  detection  for  case  20a  and  channel  1  alone  with 
(S/N)j=+3dB  and  Xn=0.9. 


evident  in  Fig.  7.6.8.  These  results  are  consistent  with  those  shown  in  Figs.  7.6.1 
to  7.6.4;  ie.,  at  the  higher  S/N  values,  the  uncorrelated  signal  case  has  a  higher  Pd 

than  the  correlated  signal  case.  Alternatively,  at  the  lower  S/N  values,  the  more 
correlated  signal  case  has  the  higher  Pd.  The  one  exception  (using  only  a  single 

trial)  is  the  detection  result  for  case  16c  and  is  noted  in  this  table.  We  will 
comment  on  this  result  at  the  end  of  this  section,  but  simply  note  that  case  16c  has 
high  temporal  and  cross-channel  correlation.  Finally,  we  note  that  the  two- 
channel  detection  results  for  Fig.7.6.7  appear  to  asymptotically  approach  a 
detection  result  slightly  above  the  single  channel  case.  This  result  would  imply 
that  the  additional  information  from  the  channel  2  data  consisting  primarily  of 
the  additive  white  noise  process  provides  a  detection  performance  improvement. 
The  sample  standard  deviations  for  the  detection  results,  however,  preclude  such 
a  conclusion. 

In  Figures  7.6.9  and  7.6.10,  we  present  detection  results  for  cases  22c 
through  29c  where  A.u=X22-0.999  and  lp12l=0.99.  The  tabulated  values  are 

displayed  in  Table  7.6.7.  We  note  that  these  processes  have  very  high  temporal 
and  cross-channel  correlation  and  therefore  closely  approximate  the  model 
I(COH)  process.  Specifically,  case  22c  with  (S/N)!=(S/N)2=+3dB  should 

approximate  (but  lie  slightly  above)  the  lower  bound  provided  by  the  model 
I(COH)  detection  curve  for  JNT=20  pulses  at  a  +3dB  signal-to-noise  ratio.  In 

table  7.6.8,  case  22c  shows  good  agreement  with  the  analytic  values.  Although 
the  result  at  Pfa=0.0693  fell  0.1%  lower  than  the  analytic  curve,  it  is  within  the 

experimental  error  limits.  The  detection  results  for  the  case  29c  process  with 
(S/N)2=-40dB  is  nearly  equal  to,  but  slightly  higher  than  that  of  the  single  channel 

case.  This  result  again  indicates  that  the  two-channel  detection  results  approach 
the  single  channel  case  in  the  limit  as  the  signal-to-noise  ratio  on  one  channel 
diminishes.  As  in  the  detection  results  for  Fig.7.6.7,  we  again  note  that  the  two- 
channel  detection  results  appear  to  asymptotically  approach  a  value  slightly  above 
the  single  channel  case.  Again,  this  result  would  imply  that  the  additional 
information  from  the  channel  2  data,  consisting  primarily  of  the  additive  white 
noise  process,  provides  a  detection  performance  improvement.  The  limited 
number  of  repeated  trials  (four),  however,  precludes  such  a  conclusion. 
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Figure  7.6.9  Probability  of  detection  results  as  a  function  of  (S/N)2  for 
lp12l=0.99,  (S/N)1=+3dB  and  Xn=X22=0.999,  Pfa=0.0693. 


Figure  7.6.10  Probability  of  detection  results  as  a  function  of  (S/N)2  for 
lp12l=0.99,  (S/N)1=+3dB  and  1=X22=0.999,  Pfe^^xlO-4. 
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case 

(S/N), 

(S/N)2 

?d 

Pfa 

22c 

+3dB 

+3dB 

0.937 

0.0693 

23c 

+3dB 

OdB 

inst 

0.0693 

24c 

+3dB 

-3dB 

inst 

0.0693 

25c 

+3dB 

-6dB 

0.898 

0.0693 

26c 

+3dB 

-9dB 

0.892 

0.0693 

27c 

+3dB 

-20dB 

inst 

0.0693 

28c 

+3dB 

-30dB 

inst 

0.0693 

29c 

+3dB 

-40dB 

0.891  ±0.002 

0.0693 

22c 

+3dB 

+3dB 

0.846 

6.93X10-4 

23c 

+3dB 

OdB 

inst 

6.93X10-4 

24c 

+3dB 

-3dB 

inst 

6.93X10*4 

25c 

+3dB 

-6dB 

0.758 

6.93x1  O’4 

26c 

+3dB 

-9dB 

0.747 

6.93X10-4 

27c 

+3dB 

-20dB 

inst 

6.93X10-4 

28c 

+3dB 

-3  OdB 

inst 

6.93X10-4 

29c 

+3dB 

-40dB 

0.746  ±0.006 

6.93X10-4 

Table  7.6.7  Probability  of  detection  results  as  a  function  of  (S/N)2  for 
\n=\22=0-999  4nd 


case 

E9 

J 

(S/N), 

(S/N)2 

P(j  (experimental) 

(analytical) 

Pfa 

X-.999  |p,2l«.99 

model  I(COH) 

22c 

10 

2 

+3dB 

+3dB 

0.937 

0.938 

0.0693 

channel  1 

10 

1 

+3dB 

- 

0.880  ±  0.004 

0.879 

0.0693 

29c 

10 

2 

+3dB 

*40dB 

0.891  ±  0.002 

0.0693 

22c 

10 

2 

+3dB 

+3dB 

0.846 

0.840 

6.93x1 0*4 

channel  1 

10 

1 

+3dB 

• 

0.728  ±  0.007 

0.710 

6.93X10*4 

29c 

10 

2 

+3dB 

-40dB 

0.746  ±  0.006 

6.93x1  O'4 

Table  7.6.8  Probability  of  detection  for  X,  1=^22=0.999  and  Ip 1 2*—0.99  with 
corresponding  analytical  results  for  the  model  I(COH)  process. 
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Finally,  we  note  that  for  cases  23c,  24c,  27c  and  28c,  instabilities  occurred. 
We  will  comment  on  thece  results  later,  but  again  indicate  that  these  instabilities 
have  occurred  for  processes  with  high  temporal  and  cross-channel  correlation. 
The  final  detection  problem  that  we  will  consider  is  a  two  channel  signal 

plus  white  noise  problem  in  which  the  channels  of  the  white  noise  are  correlated 
with  lpWi2l=0.99.  The  subscript  w  denotes  noise.  The  detection  results  are 

presented  in  Tables  7.6.9  and  7.6.10  for  Pfa=0.0693  and  6.93x10“*,  respectively. 

In  each  of  these  tables,  we  also  present  the  results  previously  obtained  without 
noise  channel  correlation.  As  noted  previously,  at  (S/N)j=(S/N)2=+3dB, 

increasing  cross-channel  correlation  on  the  signal  process  caused  Pd  to  decrease. 

At  this  signal-to-noise  ratio,  our  results  indicate  that,  the  increased  cross-channel 
correlation  on  the  noise  process  causes  Pd  to  increase.  However,  at 

(S/N)1=(S/N)2=  -5dB,  the  opposite  trend  is  noted;  ie.,  with  increasing  cross¬ 
channel  correlation  on  the  signal,  Pd  increases  while  with  increasing  cross- 
channel  correlation  on  the  noise,  Pd  decreased.  The  large  number  of  instabilities 
are  again  noted. 

We  now  comment  on  the  instabilities  which  were  noted  in  our  detection 
results.  These  occurrences  are  sometimes  noted  to  be  detection  values  which  may 
deviate  slightly  from  analytic  values  or  from  adjacent  experimental  values  on  a 
detection  curve.  On  the  other  hand,  they  were  sometimes  noted  to  be  values 
which  gave  eiuier  unity  or  zero  detection  probability  and,  in  some  cases, 
prevented  the  operation  of  the  software.  As  noted  previously,  these  unstable 
results  occur  most  often  for  the  case  of  processes  with  high  temporal  and/or 
cross-channel  correlation.  In  this  dissertation,  we  have  used  the  Cholesky 
decomposition  method  both  in  the  process  synthesis  procedure  described  in 
section  4.5  and  in  the  detection  implementation  procedure  for  eq(6.1.38).  As  we 
have  noted  previously,  when  the  processes  are  highly  correlated,  the  elements  of 
the  Cholesky  matrix  used  in  the  synthesis  method  become  very  small.  As  a  result, 
these  matrices  become  ill-conditioned.  In  future  work,  we  will  give  further 
consideration  to  the  LDLH  decomposition  in  terms  of  the  stability  problem. 
Second,  we  again  point  out  that  our  approach  to  the  detection  problem  using 
'known'  coefficients  is  an  approximation  based  on  our  use  of  a  large  amount  of  'a 
priori'  data.  We  must  therefore  consider  that,  in  some  cases,  the  variance 
associated  with  the  Strand-Nuttall  estimator  used  to  obtain  the  F,  and  F0  filter 
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case 

(S/N), 

<S/N)2 

Pj  correlated 

channel  noise 

uncorrelated 

channel  noise 

3a 

+3dB 

+3dB 

inst. 

0.999±0.0003 

3b 

+3dB 

+3dB 

inst. 

0.999 

3c 

+3dB 

+3dB 

0.999 

0.998 

4c 

+3dB 

+3dB 

0.996 

0.989±0.001 

5c 

+3dB 

+3dB 

0.980 

0.938 

2c 

-5dB 

-5dB 

0.689 

0.712±0.001 

lc 

-5dB 

~5dB 

0.440 

0.55510.005 

lb 

-5dB 

-5dB 

inst. 

0.464 

la 

-5dB 

-5dB 

inst. 

0.430 

Table  7.6.9  Detection  results  for  the  case  of  correlated  channel  noise  with 
lpw12'=0-99  and  Pfa=0.0693. 


case 

(S/N)j 

(S/N)2 

P^  correlated 

channel  noise 

P4  uncorrelated 

channel  noise 

3a 

+3dB 

+3dB 

inst. 

0.97010.001 

3b 

+3dB 

+3dB 

inst. 

0.968 

4c 

+3dB 

+3dB 

0.966 

0.94210.002 

5c 

+3dB 

+3dB 

0.927 

0.84710.001 

2c 

-5dB 

-5dB 

0.220 

0.31910.003 

lc 

-5dB 

-5dB 

0.043 

0.09810.024 

lb 

-5dB 

-5dB 

inst. 

0.063 

la 

-5dB 

-5dB 

inst. 

0.04610.003 

Table  7.6.10  Detection  results  for  the  case  of  correlated  channel  noise  with 
lpWi2l=0.99  and  Pfa=6.93xl(H. 


coefficients  may  have  been  large  enough  to  cause  inaccuracies.  These 
considerations  are  addressed  more  thoroughly  in  chapter  5.  Furthermore,  Nuttall 
[10]  has  noted  that  [Eflp.j  and^lp.!  have  not  been  shown  to  be  non-negative 

definite.  Since  the  inverse  of  these  matrices  are  used  as  the  weights  in  the  Strand- 
Nuttall  algorithm  [see  eqs(2.5.60)  and  (2.5.61)],  instabilities  could  result  due  to 
the  lack  of  positive  semi-definiteness.  Finally,  as  we  noted  in  sections  7.3  and 
7.4,  the  Monte-Carlo  procedure  itself  causes  some  inacuraeies  in  the  detection 
results  due  to  the  finite  number  of  trials  that  are  used.  However,  the  instabilities 
noted  here  are  greater  than  those  due  to  the  Monte-Carlo  procedure. 

In  this  chapter,  we  have  presented  the  procedure  used  to  evaluate  the 
detection  performance  of  the  likelihood  ratios  presented  in  chapter  6.  In  order  to 
compare  our  results  with  available  analytic  detection  curves,  we  have  focused  our 
attention  on  the  Gaussian  signal  in  additive  Gaussian  white  noise  detection 
problem  where  the  observation  processes  have  'known'  parameters.  First, 
detection  results  were  presented  as  a  function  of  signal-to-noise  ratio  and 
probability  of  false  alarm  for  signal  processes  containing  various  amounts  of 
temporal  and  cross-channel  correlation.  Second,  we  considered  the  detection 
performance  for  the  case  of  a  two-channel  process  in  which  the  signal-to-noise 
ratio  on  one  of  the  channels  decreased.  Finally,  we  considered  the  case  of 
additive  white  noise  containing  cross-channel  correlation. 
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CHAPTER  8 

SUMMARY,  CONCLUSIONS  AND  SUGGESTIONS  FOR 

FUTURE  WORK 


8.1  SUMMARY  AND  CONCLUSIONS 

In  this  section,  we  present  a  summary  of  the  contributions  made  in  this 
thesis,  as  well  as  several  conclusions.  First,  an  approach  has  been  developed  for 
the  synthesis  of  multichannel  autoregressive  (AR)  random  processes.  The 
procedure  allows  for  the  control  of  temporal  and  cross-channel  correlation 
sequences  of  synthesized  processes  subject  to  specific  constraints  for  correlation 
sequences.  The  resulting  synthesized  processes  provide  a  'fit'  in  a  minimum  mean 
squared  error  (MMSE)  sense  to  the  correlation  functions  which  are  specified  in 
terms  of  temporal  and  cross-channel  correlation  parameters  of  the  processes. 
Computer  simulation  results  are  presented  showing  the  case  of  a  two  channel  AR 
process  with  various  temporal  and  cross-channel  correlation.  A  method  is  also 
suggested  to  generalize  the  synthesized  outputs  to  obtain  Gaussian  processes  with 
unconstrained  quadrature  components  where  the  assumptions  associated  with 
stationarity  on  the  associated  bandpass  processes  are  relaxed.  These  processes 
provide  an  input  to  the  likelihood  ratio  implementation  to  obtain  detection  results 
as  a  function  of  channel  signal-to-noise  as  well  as  the  process  correlation 
parameters. 

As  a  second  contribution,  the  condition  for  ergodicity  of  auto-  and  cross¬ 
channel  correlation  functions  expressed  in  terms  of  fundamental  process 
characteristics  is  derived.  Specifically,  analytic  expressions  are  developed  for  the 
variance  of  time-averaged  correlation  functions  for  discrete,  complex  baseband 
processes.  These  expressions  provide  a  measure  which  can  be  used  to  specify  the 
window  size  of  the  observation  interval  required  to  achieve  a  specific  value  of 
this  variance.  A  unique  aspect  of  this  development  is  determination  of  the 
functional  dependence  of  these  expressions  in  terms  of  the  process  characteristics 
such  as  the  process  variance  as  well  as  the  temporal  and  cross-channel 
correlation.  In  addition,  the  analytic  expressions  are  simplified  for  the  special 
case  where  the  associated  bandpass  processes  are  wide-sense  jointly  stationary  (see 
Appendices  N  and  O).  Analytic  expressions  are  validated  using  the  multichannel 
process  synthesis  method  noted  above.  This  analysis  is  of  particular  significance 
for  the  case  of  'unknown'  process  parameters  where  the  generalized  likelihood 


223 


ratio  is  evaluated  using  parameter  estimation  algorithms  based  on  time-averaging 
methods.  In  this  case,  detection  performance  limits  result  due  to  the  errors 
associated  with  the  time-averaged  estimates. 

Third,  model-based  likelihood  ratios  are  developed  for  the  multichannel 
binary  detection  problem  using  error  vector  processes.  These  ratios  are  derived 
assuming  wide-sense  stationarity  of  the  baseband  Gaussian  processes.  However,  a 
more  general  likelihood  ratio  applicable  for  non-stationary  bandpass  processes  is 
also  developed.  In  the  special  case  of  wide-sense  stationary  bandpass  processes, 
one  of  the  likelihood  ratios  is  shown  to  reduce  to  the  multichannel  generalization 
of  the  innovations-based  detection  algorithm  (IB DA)  presented  by  Metford, 
Haykin,  and  Taylor  [24]  for  scaler  processes. 

Fourth,  the  likelihood  ratio  developed  for  the  non-stationary  bandpass 
processes  utilized  a  more  powerful  estimator  than  previously  noted.  This 
estimator  is  capable  of  whitening  not  only  the  complex  observation  processes,  but 
also  their  quadrature  components.  Furthermore,  we  point  out  that  coefficients 
for  the  more  general  linear  estimator  £(n)  proposed  in  section  6.3  could  be 
obtained  using  the  same  form  as  algorithms  proposed  for  wide-sense  jointly 
stationary  complex  baseband  processes;  ie.,  algorithms  such  as  the  Strand-Nuttall 
and  Vieira-Morf  could  be  used  but  extended  to  the  quadrature  form.  Although 
the  matrices  become  2Jx2J  rather  than  JxJ,  the  resulting  likelihood  ratios  are 
capable  of  processing  the  more  general  class  of  Gaussian  processes  with 
unconstrained  quadrature  components.  We  note  that  for  this  class  of  processes, 
the  narrowband  bandpass  processes  could  be  non-stationary. 

Detection  performance  is  obtained  for  the  special  case  where  the 
underlying  processes  are  assumed  to  have  'known'  autoregressive  process 
parameters  in  additive  white  noise.  The  procedure  used  to  obtain  these 
parameters  consisted  of  performing  estimates  with  large  amounts  of  'a  priori' 
data.  Results  for  two-channel  signal  vectors  containing  various  temporal  and 
cross-channel  correlation  are  obtained  using  a  Monte-Carlo  procedure.  These 
results  are  compared  to  known  optimal  detection  curves  for  validation.  It  was 
observed  that  at  high  signal-to-noise  ratio,  the  probability  of  detection  decreased 
with  increasing  signal  temporal  and  cross-channel  correlation  while  at  low  values, 
it  increased.  These  results  offer  insight  regarding  multichannel  processing 
methods  that  should  be  utilized  to  improve  detection  performance.  Specifically, 
at  high  signal-to-noise  ratios,  channel  diversity  (which  implies  uncorrelated 
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channel  processes)  offers  the  potential  for  improved  detection  performance. 
However,  at  very  low  signal-to-noise  ratios,  the  processing  should  utilize  multiple 
processes  which  contain  correlated  signal  information  provided  the  noise 
processes  are  uncorrelated  across  the  channels. 

Detection  performance  was  also  examined  for  the  case  where  one  of  the 
channels  was  degraded  in  terms  of  its  signal-to-noise  ratio.  It  was  determined 
that  the  detection  results  converged  to  that  of  the  channel  with  the  higher  signal- 
to-noise  ratio  as  the  performance  of  the  second  channel  diminished.  Finally, 
detection  results  were  obtained  for  the  case  where  the  additive  white  noise 
contained  cross-channel  correlation.  It  was  determined  that  the  detection  results 
for  increased  cross-channel  noise  correlation  had  the  opposite  functional 
dependence  as  that  noted  for  the  signal;  ie.,  at  high  signal-to-noise  ratio,  the 
probability  of  detection  increased  with  increasing  noise  cross-channel  correlation 
while  at  low  values,  it  decreased.  Thus,  at  low  signal-to-noise  ratios  it  is 
important  to  reduce  the  cross-channel  noise  correlation. 

Several  instabilities  were  noted  in  our  detection  results.  These  occurrences 
are  sometimes  noted  to  be  detection  values  which  may  deviate  slightly  from 
analytic  values  or  from  adjacent  experimental  values  on  a  detection  curve.  On 
the  other  hand,  they  were  sometimes  noted  to  be  values  which  gave  either  unity 
or  zero  detection  probability  and,  in  some  cases,  prevented  the  operation  of  the 
software.  As  noted  previously,  these  unstable  results  occur  most  often  for  the 
case  of  processes  with  high  temporal  and/or  cross-channel  correlation.  In  this 
dissertation,  we  have  used  the  Cholesky  decomposition  method  both  in  the  process 
synthesis  procedure  described  in  section  4.5  and  in  the  detection  implementation 
procedure  for  eq(6.1.38).  As  we  have  noted  previously,  when  the  processes  are 
highly  correlated,  the  elements  of  the  Cholesky  matrix  used  in  the  synthesis 
method  become  very  small.  As  a  result,  these  matrices  become  ill-conditioned. 
In  future  work,  we  will  give  further  consideration  to  the  LDLH  decomposition  in 
terms  of  the  stability  problem.  Second,  we  again  point  out  that  our  approach  to 
the  detection  problem  using  'known'  coefficients  is  an  approximation  based  on 
our  use  of  a  large  amount  of  'a  priori'  data.  We  must  therefore  consider  that,  in 

some  cases,  the  variance  associated  with  the  Strand-Nuttall  estimator  used  to 
obtain  the  Ft  and  F0  filter  coefficients  may  have  been  large  enough  to  cause 

inaccuracies.  These  considerations  are  addressed  more  thoroughly  in  chapter  5. 
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Furthermore,  Nuttall  [10]  has  noted  that  and[Zb]p.j  have  not  been  shown  to 

be  non-negative  definite.  Since  the  inverse  of  these  matrices  are  used  as  the 
weights  in  the  Strand-Nuttall  algorithm  [see  eqs(2.5.60)  and  (2.5.61)],  instabilities 
could  result  due  to  the  lack  of  positive  semi-definiteness.  Finally,  as  we  noted  in 
sections  7.3  and  7.4,  the  Monte-Carlo  procedure  itself  causes  some  inacuracies  in 
the  detection  results  due  to  the  finite  number  of  trials  that  are  used.  However,  the 
instabilities  noted  here  are  greater  than  those  due  to  the  Monte-Carlo  procedure. 
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8.2  SUGGESTIONS  FOR  FUTURE  WORK 


8.2.1  Multichannel  Modeling  and  Model  Order  Selection 

The  detection  approach  evaluated  in  this  dissertation  is  model-based;  ie., 
the  underlying  signal  and  clutter  noise  processes  are  assumed  to  be  characterized 
by  parametric  models  such  as  autoregressive  processes.  This  approach  leads  to  a 
realizable  architecture  which  can  be  implemented  for  the  detection  of  random 
signals  in  noise  and  is  amenable  for  adaptive  processing  methods.  However, 
detection  performance  is  linked  to  the  validity  of  the  model  representation  of  the 
observation  processes  [20].  Furthermore,  the  model  representation  is  highly 
problem  dependent;  ie.,  the  characterization  of  the  observation  processes  by  an 
appropriate  model  must  be  tailored  to  the  specific  problem  being  addressed.  For 
example,  the  models  applicable  for  processes  observed  by  a  pulse-Doppler  radar 
may  be  significantly  different  than  those  observed  by  a  wideband  high  resolution 
radar. 

In  the  introduction,  we  noted  several  analyses  involving  the  modeling  of 
processes  with  time  series  for  a  wide  range  of  applications.  In  the  radar  problem, 
however,  a  limited  number  of  investigations  regarding  the  characterization  of 
clutter  processes  using  autoregressive  models  has  been  conducted 
[26,41,42,79,80,91,92,93].  Furthermore,  we  are  not  aware  of  any  parametric 
modeling  analyses  for  multichannel  radar  applications  where  multichannel 
indicates  waveform  diversity  such  as  multiple  center  frequencies  and  polarization. 
Noting  the  similarity  between  one-dimensional  multichannel  and  two-dimensional 
single  channel  methods  [11,12],  extensions  could  be  made  to  range  cross-range 
imaging  analyses  [94]. 

The  validation  of  such  models  in  specific  applications  therefore  constitutes 
an  essential  area  for  further  research.  Such  an  investigation  must  include  a  data 
collection  program  capable  of  providing  a  sufficient  data  base  to  obtain  high 
confidence  on  the  parameter  estimates.  A  quantitative  measure  on  the  data  base 
window  size  requirements  could  be  assessed  with  the  ergodicity  analysis 
described  in  chapter  5. 

As  noted  in  section  6.4,  determination  of  the  model  orders  which  fit  the 
observation  data  processes  under  both  hypotheses  is  important  in  the  detection 
implementation  procedure;  ie.,  it  enables  the  determination  of  the  filter  orders  in 
the  detection  architecture.  Model  order  selection  methods  for  AR  and  ARMA 
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models  has  been  given  extensive  consideration  for  single  channel  processes 
[36,63,66,67,96-114].  The  extension  of  these  analyses  to  the  multichannel  case 
requires  further  investigation,  however. 

We  also  note  an  interesting  and  potentially  useful  feature  of  multichannel 
AR  processes  which  may  be  significant  in  the  modeling  as  well  as  the  detection 
analyses.  In  this  dissertation,  we  have  used  underlying  AR  models  to  describe  the 
signal  and  clutter  processes.  However,  as  noted  in  previous  chapters, 
autoregressive  moving  average  (ARMA)  models  could  be  used  to  model  the 
summation  of  AR  models  of  lower  order  [36]  or  the  summation  of  an  AR  model 
plus  additive  white  noise  [95].  Nuttal  [10],  however,  has  also  noted  that  a 
multichannel  AR  process  contains  channel  elements  which  are  in  themselves 
single  channel  ARMA  processes.  This  is  due  to  the  increased  degrees  of  freedom 
of  the  multichannel  AR  process  [17].  It  therefore  appears  that,  under  certain 
conditions,  multichannel  processes  containing  a  summation  of  underlying  AR 
processes  and  white  noise  may  be  very  accurately  modeled  as  a  multichannel  AR 
process  with  relatively  low  order.  This  result  is  significant  since  it  implies  that 
lower  order  multichannel  filters  may  be  implemented  in  the  detection 
architecture.  The  conditions  under  which  this  reduced  order  modeling  may  be 
achieved  is  an  area  for  further  investigation. 


8.2.2  Analytic  Detection  Approach  for  Multichannel  Processes 

The  analytic-numeric  integration  method  of  Schwartz  [115]  for  the  single 
channel  case  provides  expressions  for  the  probabilities  of  detection  Pd  and  false 

alarm  Pfa.  These  equations  (also  discussed  in  [23])  are  expressed  as 


and 


Pd=l-^jRe 

0 

oo 

Pfa  =  l-i  J Re 
0 


f  (-l/j£)  [exp(-j^T)  -1]  1 

jdet[I  -  2j£(Rd  +  RS)*R*] 


f(-l/j4)  Lexp(-j£T)  -1]  1 

1  det[I  -  2j$(Rd)*R*] 


(8.2.1) 


(8.2.2) 


where  T  is  the  threshold  and  the  single  channel  correlation  matrices  are  expressed 
as 
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R<i  =  Rg  +  Rw  (8.2.3) 

R  =  (Ril 2 3 4  -  (Rd  +  Rj)*1]  (8.2.4) 

Rs  =  E[*aH]  (8.2.5) 

Rc  =  E(££h]  (8.2.6) 


The  extension  of  these  equations  to  the  multichannel  case  can  be  made  using 
the  correlation  matrices  discussed  in  section  4.3. 

8.2.3  Multichannel  Algorithm  Development 

Detection  performance  for  the  'unknown’  signal  case  using  estimation 
procedures  in  the  generalized  multichannel  likelihood  ratios  developed  here  is 
critically  dependent  upon  the  multichannel  algorithms  [6-11,25,29,32,60,128- 
137].  The  continued  development  and  practical  implementation  of  multichannel 
algorithms  constitutes  an  essential  research  area  for  further  development. 
Algorithm  performance  must  be  assessed  in  terms  of  computational  complexity, 
efficiency  with  limited  data,  number  of  operations  per  iteration,  numerical 
stability,  implementation  into  structural  processing  architectures,  and  suitability 
for  VLSI  implementation.  Consideration  has  been  given  to  the  use  of  modular 
processing  architectures  for  the  implementation  of  adaptive  multichannel  lattice 
algorithms  [130,131].  In  this  approach,  a  modular  decomposition  is  applied  to 
multichannel  lattice  recursions  to  transform  them  to  single-channel  (scalar) 
recursions.  Levi-Ari  [131]  has  noted  that  the  following  properties  are  realized 
through  this  approach: 

1.  Only  scalar  computations  are  required. 

2.  The  architecture  is  modular,  regular  (all  cells  are  identical)  and 
requires  only  local  communication.  It  is,  therefore,  well  suited 
for  VLSI  implementation. 

3.  Computations  are  performed  in  parallel  and  information  flows 
between  cells  in  a  pipeline  fashion.  Thus,  the  throughput  is 
independent  of  the  number  of  channels. 

4.  The  architecture  is  expandable.  The  number  of  channels  can  be 
increased  by  connecting  together  several  identical  subsystems. 
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He  also  notes  that  'the  principle  of  modular  decomposition  that  is  used  to 
derive  this  architecture  is  remarkably  universal.  Exact-least-squares  lattice 
algorithms  obey  this  principle  because  they  all  share  an  inherently  modular 
geometric  interpretation  [130].  The  scope  of  applicability  of  the  decomposition 
principle  extends,  however,  much  beyond  this  particular  class  of  algoritms, 
including,  for  instance,  systolic  array  architectures  for  convolution  and  matrix 
multiplication  [141,142]’. 

Consideration  has  also  been  given  to  the  use  of  Gram-Schmidt 
orthogonalization  predictor  realizations  to  implement  algorithms  for  filter 
coefficient  (weight)  updating  [140-142].  The  Gram-Schmidt  orthogonalization 
procedure  has  particular  significance  in  the  interpretation  and  realization  of 
innovations  processes  [59].  Block-processing  algorithms  have  also  been 
considered  for  high  speed  processing  applications  [143-151].  These  methods  are 
useful  when  the  cost  associated  with  updates  at  each  data  point  is  too  high  [151]. 
Investigation  of  these  methods  in  terms  of  numerical  accuracy,  complexity, 
efficiency,  as  well  as  suitability  for  implementation  into  processing  architectures 
remains  a  viable  area  for  further  research. 

8.2.4  Detection  with  Unconstrained  Gaussian  Quadrature 
Components 

In  this  dissertation,  we  have  also  considered  the  more  general  class  of 
Gaussian  processes  containing  correlated  quadrature  components  which  are  not 
restricted  to  the  conditions 

R",(l)  =  O)  (8.2.7a) 

and 

Usd)  =  -  R?'(l)-  (8.2.7b) 

A  synthesis  procedure  is  presented  in  section  4.6  and  a  likelihood  ratio  is 
developed  in  section  6.3  for  these  more  general  processes.  Implementation 
architectures  and  detection  results,  however,  were  presented  for  the  more 
restrictive  case  of  processes  satisfying  eqs(8.2.8).  Detection  results  for  the  more 
general  case  would  provide  a  valuable  extension  of  the  results  presented  here. 
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We  again  note  that  the  more  general  case  involves  processes  with  non-stationary 
bandpass  processes. 

8.2.5  Detection  Performance  versus  Estimator  Error  Variance 

In  many  signal  processing  applications  it  is  necessary  to  estimate 
parameters  of  a  random  process.  Typically,  time-averaging  procedures  are 
employed  for  this  purpose.  For  example,  algorithms  such  as  the  Levinson,  Burg 
and  Strand-Nuttall  recursion  methods  are  used  to  estimate  autoregressive  (AR) 
parameters  of  the  processes.  It  is  often  noted,  however,  that  unacceptably  large 
deviations  in  the  estimates  can  result  if  a  sufficient  observation  window  size  is  not 
utilized;  ie.,  for  a  given  observation  sample  size,  the  variance  of  the  estimates  can 
be  very  large.  Such  a  condition  results  in  unnaceptably  low  confidence  levels 
associated  with  the  quality  of  the  estimate.  In  these  estimation  problems,  what  is 
often  overlooked,  is  the  explicit  dependence  of  these  deviations  not  only  on  the 
observation  window  size,  but  also  on  'fundamental'  characteristics  of  the 
processes  such  as  the  temporal  correlation,  variance  and  (in  certain  cases)  the 
cross-correlation  of  the  processes.  More  specifically,  for  a  given  window  size, 
these  characteristics  of  the  processes  determine  fundamental  limits  on  the  quality 
of  the  estimates.  To  our  knowledge,  no  simplified  procedure  has  been  suggested 
which  enables  one  to  quantitatively  determine  the  functional  relationship  between 
the  quality  of  a  given  estimator  and  these  process  characteristics. 

In  chapter  5,  we  developed  a  procedure  in  which  time-averaged  estimates 
and  their  variances  are  expressed  not  only  in  terms  of  the  observation  sample  size 
time  window,  but  also  on  the  fundamental  process  parameters  which  limit 
estimation  performance.  Specifically,  the  ergodicity  conditions  for  the  time- 
averaged  complex  auto-  and  cross-correlation  function  estimators  are  considered. 
The  unique  aspect  of  this  development  is  the  simplified  procedure  for 
determining  the  functional  dependence  of  the  ergodic  assumption  in  terms  of  the 
'fundamental'  characteristics.  The  resulting  analytic  expressions  determine  the 
signal  processing  requirements  to  achieve  a  specified  variance  of  the  estimator. 
These  expressions  provide  much  more  insight  regarding  the  functional  role  of  the 
process  characteristics  in  determining  the  ergodic  behavior  than  previously  noted. 
Furthermore,  the  analytic  expressions  are  derived  for  the  general  case  of 
Gaussian  processes  with  unconstrained  quadrature  components  where  the  usual 
assumptions  associated  with  the  correlation  of  the  quadrature  components  are 
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relaxed.  Validation  of  the  analytic  expressions  was  presented  using  the 
multichannel  synthesis  method  described  in  chapter  4. 

We  suggest  the  extension  of  this  approach  to  the  estimation  algorithms 
utilized  in  the  detection  implementation  architecture  presented  here.  Specifically, 
for  the  case  of  'unknown'  process  parameters,  detection  performance  should  be 
evaluated  using  the  parameter  estimation  algorithms  based  on  the  time-averaging 
methods.  Particular  emphasis  should  focus  on  the  detection  performance  limits 
resulting  from  the  errors  associated  with  these  estimates;  ie.,  the  error  variance 
associated  with  the  parameter  estimates  will  result  in  a  corresponding  error 
variance  associated  with  the  detection  results. 

8.2.6  Detection  Performance  with  Multipath,  Feedback  and  Model- 
Mismatch 

In  this  section,  we  note  two  investigations  which  could  be  conducted  to 
consider  the  robustness  of  the  detection  method  considered  in  this  dissertation. 
First,  detection  in  the  presence  of  multipath  clutter  or  system  feedback  could  be 
evaluated  using  a  minor  extension  of  the  process  synthesis  procedure  described  in 
section  4.5.  This  would  involve  modifications  of  the  procedure  described  in 
block  form  by  Fig.  4.5.1.  As  an  example,  we  could  consider  the  system  shown  in 
Fig  8.2.1. 
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Fig  8.2.1  Process  Synthesis  Procedure  involving  Feedback  and  Multipath. 

We  note  in  this  case  that  the  signal  contains  a  delayed  and  weighted  clutter 
sample  in  an  additive  manner,  thereby  including  the  effect  of  multipath.  The 
delay  is  contro’^d  by  'p*  and  the  weight  by  'a'.  Replacing  the  addition  operation 
with  multiplication  would  enable  the  modeling  of  multiplicative  noise  processes. 
Processes  synthesized  as  shown  in  Fig.  8.2.1  now  provide  an  input  to  the 
detection  implementation  architectures.  Performance  could  be  evaluated  in  terms 
of  the  clutter  weighting  and  delay.  Multiple  delays  can  be  modeled  by  additional 
delay  elements  in  the  synthesis  network. 

Second,  the  robustness  of  the  model-based  detection  method  could  be 
evaluated  in  terms  of  model  mismatch  to  the  observation  data  processes.  An 
example  of  such  a  mismatch  could  consist  of  the  case  where  lower  model  orders 
are  incorrectly  assumed  for  the  observation  processes  under  either  (or  both) 
hypotheses.  This  would  cause  one  to  use  lower  filter  orders  on  either  (or  both) 
of  the  F0  and  Fj  filters  in  the  detection  implementation  architecture.  Detection 

performance  evaluations  as  a  function  of  the  filter  orders  could  be  conducted. 

8.2.7  Sequential  Detection  for  Discrimination 

The  theory  of  sequential  binary  hypothesis  testing  was  developed  by  Wald 
[152,153]  and  generalized  to  the  multiple  hypothesis  case  by  Reed  [154].  In  [155], 
Selin  considered  the  detection  of  a  deterministic  signal  in  Gaussian  noise.  In  this 
work.  Karhunen-LoSve  basis  functions  were  used  to  obtain  a  set  of  uncorrelated 
and,  therefore,  independent  observations.  This  approach  was  motivated  by  the 
fact  that  independent  observations  greatly  simplify  the  sequential  test.  The 
extension  of  the  sequential  appioach  using  linear  mean-square  prediction  to 
obtain  causally  transformed  innovations  processes  is  summarized  in  the  tutorial 
by  Thcrrien  [39]  noting  the  pioneering  work  of  Schweppe  [1]  and  Selin  1156]. 
Application  areas  are  noted  in  [157-160].  In  this  approach,  the  classifier 
structure  involves  a  two  step  procedure  involving  linear  prediction  followed  by  a 
comparison  test  using  the  accumulated  prediction  errors.  Following  the 
discussion  by  Therrien  [39], 

Since  linear  prediction  can  often  be  performed  on  just  a  short 
history  of  the  process,  a  great  economy  of  storage  and  computation 
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time  can  result.  Since  the  classifier  compres  the  accumulated 
prediction  errors,  discrimination  is  based  on  the  entire  set  of 
observations  and  not  just  on  the  number  of  observations  used  for 
linear  prediction.  Further,  if  the  process  is  stationary,  the  classifier 
is  open-ended.  That  is,  if  a  sufficiently  long  prediction  interval  is 
taken,  the  filters  used  for  linear  prediction  are  approximately  time 
invariant  and  the  sequential  test  can  continue  for  as  long  as  necessary 
without  continual  modification  of  the  filter  parameters. 

The  recursive  classifier  structure,  though  ideal  for  sequential 
discrimination,  is  not  limited  to  that  application.  The  structure  can 
also  be  used  to  implement  fixed  statistical  tests  such  as  those  of  the 
Bayes  or  Neyman-Pearson  type  and  it  shares  some  common  features 
with  estimator/correlator  receiver  realizations  [1,51,54,19  Part  III]. 
Further,  although  the  optimal  properties  will  not  hold,  the  classifier 
can  be  applied  to  signatures  with  non-Gaussian  distributions  and 
several  interpretations  are  possible.  In  particular,  the  classifier  can 
be  described  in  the  time  domain  in  terms  of  autoregressive  time 
series  models  [36],  Gauss-Markov  state  models  [161],  and  innovations 
concepts  [54],  In  the  frequency  domain  it  can  be  related  to  the  so- 
callcd  data  adaptive  methods  of  spectral  estimation  [162]. 

The  extension  cf  the  approach  outlined  in  [39]  to  the  multichannel  case 
remains  an  area  for  further  investigation.  The  multichannel  approach  presented 
in  this  dissertation  should  readily  extend  to  the  use  of  multiple  processes  in  the 
sequential  detection  procedure.  Thus,  a  practical  methodology  can  be  established 
to  utilize  information  from  multiple  processes  in  the  discrimination  problem. 

8.2.8  Detection  using  Wideband  Radar  Waveforms 

A  limited  number  of  radar  detection  analyses  have  been  conducted  using 
wideband  transmitter  waveforms  [116-118].  These  analyses  utilize  the 
compressed  radar  pulse  to  over-resolve  the  target  signal  source  along  the  slant 
range  axis  and  assess  detection  performance  over  range  cells  using  incoherent 
integration. 

The  use  of  the  multichannel  detection  method  presented  in  this  dissertation 
could  provide  a  very  useful  approach  for  analyses  involving  wideband  radar 
systems.  In  this  case,  we  could  view  each  channel  to  consist  of  a  distinct 
frequency  interval  of  the  transmitted  spectral  bandwidth.  For  closely  spaced 
frequency  inte'vals,  partial  correlation  may  exist  between  channels.  The 
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multichannel  detection  methods  presented  here  utilize  these  channel  processes  to 
achieve  integration  gain  in  terms  of  both  temporal  and  cross-channel  correlation. 
The  multichannel  approach  offers  the  potential  to  efficiently  utilize  all  of  the 
information  contained  in  the  spectral  bandwidth  of  the  received  data  processes 
since  the  processing  is  coherent  in  both  of  these  dimensions.  However, 
computational  complexity  will  also  increase  as  the  number  of  channels  increases. 

8.2.9  Detection  using  Multiple  Sensors 

The  use  of  multiple  sensors  to  improve  detection  performance  has  been 
given  considerable  attention  in  recent  years  [119-125].  For  sensors  distributed  in 
location,  practical  constraints  such  as  communication  channel  bandwidth  dictate 
that  local  decisions  be  made  at  each  sensor  with  subsequent  detection  decisions 
performed  at  the  fusion  center.  Thus,  thresholding  is  performed  at  each  sensor 
to  make  a  hypothesis  selection.  The  transmission  of  this  binary  decision  can 
therefore  be  communicated  at  a  much  lower  bit  rate.  This  detection  scheme  is 
referred  to  as  the  decentralized  method.  Unfortunately,  the  practical  advantages 
of  the  decentralized  scheme  are  achieved  at  the  expense  of  optimality  in  detection 
performance.  Researchers  have  often  noted  'insignificant'  loss  of  performance 
[119]  when  compared  to  the  case  of  centralized  processing;  ie.,  the  case  where  all 
the  observation  data  is  available  for  processing  so  that  a  single  threshold  is 
established.  However,  these  analyses  have  not  considered  the  more  general  case 
of  correlated  sensor  observations.  Furthermore,  they  do  not  compare  their 
results  to  the  case  where  coherent  processing  is  used  across  the  sensor 
observations.  In  this  dissertation,  the  multichannel  approach  involves  a 
'centralized'  processing  method.  Not  only  does  this  approach  offer  the  potential 
for  optimality  in  the  Gaussian  detection  problem,  it  also  enables  the 
implementation  of  coherent  processing  across  channels  as  well  as  in  time. 
Viewing  each  channel  as  a  sensor  process,  coherent  processing  across  sensors 
cannot  be  achieved  in  the  decentralized  approach.  On  the  other  hand,  the 
centralized  processing  approach  often  involves  considerable  computational 
complexity  in  addition  to  the  increased  transmission  data  rate  requirements.  It 
would  therefore  appear  that  the  multichannel  approach  as  applied  to  the  sensor 
fusion  problem  would  be  most  applicable  to  the  situation  where  sensor  suites  are 
situated  locally  and  sufficient  computational  resources  are  available. 
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An  interesting  dimension  of  the  multichannel  approach  to  multiple  sensor 
applications  would  involve  consideration  of  dissimilar  sensors.  In  the  radar 
problem,  this  might  consist  of  radars  operating  at  widely  separated  frequencies 
each  of  which  may  be  operating  with  multiple  polarization  vectors.  In 
earthquake  analyses,  the  use  of  sensors  such  as  seismometers,  shearometers, 
tiltometers,  etc.  could  all  be  used  to  determine  a  ’change’  in  the  observation 
processes.  The  prime  feature  of  the  likelihood  ratio  developed  here  is  the 
capability  to  transform  these  dissimilar  multichannel  processes  to  error  residuals. 

These  error  residuals  in  turn  are  utilized  to  measure  the  change  in  the  processes 
characterized  by  a  given  set  of  parameters  (hypothesis  H0)  to  another  set 

(hypothesis  Hj).  Thus,  the  multichannel  approach  offers  the  potential  to  utilize 
all  of  the  information  from  these  distinct  sensor  processes  in  the  detection 
problem.  Furthermore,  if  correlation  does  exist  among  these  ’distinct’  processes, 
the  multichannel  method  will  utilize  this  additional  information  in  the  detection 
scheme.  In  the  case  where  no  cross-channel  correlation  is  present,  the  ’likelihood 
ratio  implementation  scheme  reduces  to  the  special  case  using  diagonal  matrix 
coefficients. 

In  the  radar  problem,  the  use  of  dissimilar  sensors  presents  practical 
problems  such  as  the  determination  of  a  common  surveillance  volume,  multiple 
signal  sources,  differences  in  data  rates,  and  missing  data. 
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APPENDIX  A 

MMSE  CRITERION  APPLIED  TO  THE 
MULTICHANNEL  LINEAR  PREDICTOR 

In  this  appendix,  we  first  consider  the  multichannel  minimum  mean- 
squared  error  (MMSE)  criterion  for  a  linear  predictor.  Under  this  criterion,  we 
show  that  the  coefficients  of  the  linear  predictor  satisfy  the  normal  equations. 
Second,  we  show  that  the  resulting  error  vector  is  uncorrelated  with  past 
observations.  Finally,  we  show  that  the  error  vector  is  a  statistically  independent 
white  noise  process.  We  will  follow  the  derivation  presented  by  [Nuttal  76a] 
using  our  notation.  From  eqs(2.4.1)  and  (2.4.2),  we  have 


£p(n)  =  &(n)  -  ip(nln-l,...,n-p) 

(A.la) 

=  2L(n)  +  y  Ap(k)i(n-k) 

(A.  lb) 

k=l 

=  &(n)  +  (A)p  in-i,n-p 

(A.lc) 

where 

£0(nln-l,...,n-p)  =  -  £  Ap(k)x(n-k) 

(A.2) 

k=l 

in- 1, n-p  =  liT(n*l)  xT(n-2) ...  xT(n-p)] 

(A. 3) 

and  the  vector  of  matrices  (AJr?  is  the  same  as  that  defined  in  eq(2.4.3a),  out 
without  the  identity  matrix  I,  so  that 

(A),  -  [Ap(l)  Ap  (2)  ...  Ap  (p)].  (A.4) 

Let 

EU(n)&J.lfn_p]sC  (A.5) 

and 

n-pin-i, n-p]  =  t^xx^p  5:5  Q*  (A. 6) 
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rr" '  t" 


pj 

With  respect  to  dimensions,  (A)-  is  JxJp,  in>i>n-p  *s  Jp*l*  C  is  JxJp  and  Q 

is  JpxJp.  We  note  that  QH  =  Q  and  VHQV>0  for  any  Jpxl  vector  V*Q  when  Q  is 
positive  definite.  Now,  the  JxJ  error  covariance  matrix  is  expressed  as 

Efcp(n)£p(n)]  =  E{(i(n)  +  <A)pin.1,i,.pKxH(n)+  J?.i,n-p(A)p]}  (A.7a) 

=  E[s(n)s"(n)]  +  (A)pCH  +  C(A)p  +  (A)"  Q(A)P  (A. 7b) 

=  R„(0)  -  CQ  'CH  +  [(A)"  +  CQ  ']Q[(A)p  +  CQ  ‘)h.  (A.7c) 

H  1 

Let  the  JxJp  matrix  [(A)p  +  CQ'  j  be  expressed  as 


[(A)p+CQ‘) 


(A. 8) 


where  X.j  is  a  Jpxl  vector.  We  now  denote  the  last  term  in  eq(A.7c)  as  the  JxJ 
matrix 


L  =  [(A)?  +  CQ'1]  Q[(A)?  +  CQ-‘]h  -  [lmj] 
Q  [yLi  V2  ...  Vj] 


ryHH 

V? 


H 


1  £  m,j  <,  J  (A.9a) 


(A. 9b) 


where  the  complex  scalar  lmj  is  now  expressed  as 

Wj  =  YmQYj- 


(A.  10) 
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The  real  quantity  Ijj  =  YjHQ Y.j  >  0  for  any  Y.j  *  Q.  ,  since  Q  is  Hermitian  and 

provided  Q  is  positive  definite;  the  minimum  value  of  Ijj  is  zero  and  is  attained  if 
and  only  if  Y—Q..  Therefore,  trL  is  minimized,  attaining  value  zero,  by  the 
choice  ,  l£j£J.  Using  eq(A.7c),  trE[£p(n)£p(n)]  =  E[£p(n)£p(n)]  is 

H 

minimized  by  the  choice  of  (A)p  as 


(A)p  =  -  CQ1  (A.  11  a) 

or 

Q(A)P=-CH  (AUb) 

since  the  leading  two  teims  in  eq(A.7)  are  independent  of  (A)p-  Eq(A.llb)  can 
be  written  in  expanded  form  using  eqs(A.2),  (A.5)  and  (A.6),  so  that 


Rs>(0)  R„(l)  R„(2)  ...R„(p-1) 

Rxji('i)  R„(«)  R»(D  -R»(P-2) 

•  •  •  •  • 

•  •  •  «  • 

R„(2-p)R„(3-p)R„(4-p)...  Rxx(1) 
R„(l-p)R„(2-p)Rxx(3-p)...  R„(0) 


Ap(l)  " 
Ap(2) 

•  •  « 

Ap(p-1) 
Ap(p)  _ 


(A.  12) 


Eq(A.12)  contains  the  normal  equations  (not  to  be  confused  with  its 
augmented  form)  for  a  prediction  error  filter  of  order  p  and  can  also  be 
expressed  as 

£  Rxx(k-m)Ap(k)  =  -  Rxx(-m)  m  =  1,2 p  (A.  13) 

k=l 

or 

Ap(k)Rxx(m-k)=  -  Rxx(m)  m  =  1,2 . p.  (A.14) 


252 


We  now  show  that  the  error  vector  £.p(n)  is  uncorrelated  with  past 
observation  vectors  when  eqs(A.14)  hold.  Eq  (A.14)  can  be  expressed  as 


Ap(k)E[i(n  -  k)*H(n  -  m)]  =  -  E[*(n)*H(n  -  m)] 


m 


l,2,...,p. 


(A.  15) 


Rearranging  eq(A.15)  and  interchanging  the  order  of  expectation  and 
summation,  we  can  obtain 


E< 


i(n)  + 


Ap(k)2L(n  -  k) 


iH(n  -  m)  =  [0] 


m  =  l,2,...,p.  (A.  16) 


From  eq(A.lb),  it  follows  that 

E[£p(n)iH(n  -  m)]  =  [0]  m  *  l,2,...,p.  (A.  17) 

Eq(A.17)  is  the  principle  of  orthogonality.  It  indicates  that  the  MMSE 
vector  £p(n)  is  uncorrelated  with  past  data.  We  can  also  show  that  the  MMSE 

vector  process  £p(n)  is  a  white  noise  process.  Following  a  similar,  although  more 

general  discussion  than  that  presented  by  Kailath  [57],  let  us  consider  the 
observation  process  x.(n)  such  that 

*(n)  =  &(n)  +  £(n)  +  \y(n) 

=  i(n)  +  w(n) 

where 

Z(n)  s  s(n)  +  £(n),  (A.  18c) 

i(n)  and  £(n)  are  the  signal  and  non-white  clutter  processes,  respectively,  and 
jy.(n)  is  a  zero-mean,  white  noise  vector.  We  will  assume  that  the  signal  is 
uncorrelated  with  future  clutter  samples,  but  not  with  past  values  of  the  clutter. 


(A.  18a) 
(A.  18b) 
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In  addition,  we  assume  j(n)  is  uncorrelated  with  future  white  noise  samples,  but 
not  necessarily  with  its  past  values.  We  now  consider  the  estimate  &(nln-l)  such 
that 


&(nln-l)  =  E[&(n)ln-1]  (A.19a) 

=  E[*(n)  +  Mn)ln- 1  ]  (A.  1 9b) 

=  £(nln-l)  +  &(nln-l)  (A.  19c) 

Since  &(nln-i)  is  the  mean  of  the  conditional  density  function  pw(wln-i), 
and  since  the  mean  of  pw(wln-i) «  pw(w)  is  zero,  then  with  &(nln-l)=Q,  eq(A.19c) 
reduces  to 

£(nln*l)  =  £(nln-l)  (A.19d) 

so  that 

E[£„(n)£p(k))  =  E{  (i(n)  -  £(nln-l)][s(k)  -  £(klk-l)]H}  (A.20a) 

=  E{  [2(n)  +  jv(n)][2(k)  +  n(k)]H}  (A.20b) 

=  E[2(n)2H(k)]  +  E[w(n)iH(k)] 

+  E[2(n)2!H(k)|  +  E(a(n)aH(k)].  (A.20c) 

where 

Z(n)  -  z(n)  -  £(nln-l)  (A.21) 

and  the  notation  ~  denotes  error  in  this  section.  For  n>k, 

E[ai(n)2H(k)]  =  [0]  (A.22) 

so  that 

E[£p(n)£p(k)]  =  E[2(n)fH(k)]  +  E[z(n)wH(k)]  +  E[w(n)wH(k)].  (A.23) 
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Since  £(klk-l)  is  a  linear  combination  of  past  data  up  to  time  (k-i),  the 


orthogonality  principle  results  in  E[z(n)2H(klk-l)M0].  Hence, 

E[£(n)2H(k)]  =  E{z(n)fe(k)  -  £(klk-l)]H}  (A.24a) 

=  E[2(n)zH(k)]  n  >  k  (A.24b) 

so  that 

E[£p(n)£^(k)]  =  E[z(n)iH(k)]  +  E[2(n)*H(k)]  +  E[a(n)H;:(k)].  (A.25a) 

=  E(z(n)sH(k)]  +  E[ffi(n)wH(k)].  (A.25b) 

Again,  the  orthogonality  principle  yields  E[z  (n)xH(k)]  =  [0]  for  n>k,  so  that 

Efep(n)£p(k)]  =  E[w(n)w:,(k)]  =  [0]  n  >  k.  (A.26) 

For  n<k, 

E[f  (n)wH(k)]  =  [0]  (A.27) 

so  that  from  eq(20.c) 

E(£p(n)£p(k)]  =  E[2(n)2H(k)]  +  E[jv(n)2H(k)l  +  E[w(n)s-H(k)].  (A.28) 


But, 


E[2(n)fH(k)]  =  E  { [z(n)  -  £(nln-l)]  2hOO  ) 

=  Eton)  2H(k))  n  <  k. 


(A. 29a) 
(A. 29b) 


Now, 


E[£p(n)£p(k)]  =  E[£(n)  2H(k)]  +  E[w(n)fH(k)]  +  E[w(n)wH(k)).  (A.30a) 


255 


=  E[i(n)  ZH(k)]  +  E[iv(n)ffiH(k)]. 


(A.30b) 


Again,  the  orthogonality  principle  yields  E[j(n)  sH(k)]  =  [0]  for  n<k,  so  that 

E[£p(n)£^(k)]  =  Etffi(n)iyH(k)l  =  [0]  n  <  k.  (A.31) 


At  k=n, 

E[£p(n)£p(n>]  =  E(j(n)iH(n)]  +  E[w(n)£H(n)] 

+  E[z(n)wH(n)]  +  E[w(n)&H(n)].  (A.32) 

But,  noting  that  £(klk-l)  is  a  linear  combination  of  past  data  up  to  time  (n-1),  we 
have 


E[&(n)jH(n)]  =  E{^(n)[i(n)  -  £(nln-l)]H}  (A.33a) 

=  Eto(n)iH(n)]  =  Rw2(0)  (A.33b) 

E[Z(n)wH(n)]  =  E[i(n)\vH(n)]  =  Rzw(0)  =  r"z(0).  (A.34) 


And  so 


E[£p(n)£p(k)l 


MOHR^OHR^OHR^O) 

[0] 


k=n 

k*n. 


(A.35) 


where 


R??(0)  =  E[i(n)zH(n)]. 


(A  .36) 
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* 


Eq(A.35)  indicates  that  £p(n)  is  a  white  noise  process.  The  covariance 

matrices  in  eq(A.35)  can  be  examined  further.  When  the  zero-mean  additive 
white  noise  ac(n)  is  uncoirelated  with  the  signal  and  clutter  processes,  then 


Rwz(0)  =  Rw(0)  =  [0] 


(A.37) 


so  that  eq(A.35)  becomes 


E[£p(n)£^(n)]  = 


M°)  +  Rww(0) 

[03 


k=n 

k*n. 


(A.38) 


The  covariance  matrix  Rj2<0)=E[i(n)zH(n)]  can  also  be  considered  further 


as 

R^(0)=E(i(n)iH(n)]  =  E  { (J(n)  +  £(n)]ff(n)  +  £(n)]H }  ( A.39a) 

-  E[5(n)5H(n)]  +  E[s(n)fiH(n)]  +  E[£(n)SH(n)]  +E[f  (n)£H(n)]  (A.39b) 
=  Rss^O)  +  Rsc<°)  +  R^s<0)  +  Rcc<0)  (A.39c) 

where 

R^O)  =  E[s(n)sH(n)]  (A.40a) 

R^O)  =  E(s(n)£H(n)3  (A.40b) 

Rer^O)  =  E[f(n)sH(n)]  (A.40c) 

Rw(0)  =  E[£(n)£H(n)].  (A.40d) 


Finally,  although  the  MMSE  vector  £p(n)  has  been  shown  to  be  temporally 
white,  note  that  its  components  can  be  correlated  across  the  channels. 
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APPENDIX  B 

DERIVATION  OF  EQS(2.5.74)  AND  (2.5.84) 


In  this  appendix,  we  derive  eqs(2.5.74)  for  J=2  and  (2.5.84)  for  J=3. 
Using  J=2  in  eq(2.5.71a),  we  have 


P  =  (-1)°  ®AqCB  +  UDoAjCB0  =  CB  -  (B.la) 

=  CB  ‘(AA0  +  afiC  (B.lb) 

=  CB  -  [A  -  tr(AA0)l]C  (B.lc) 

=  CB  -  [yl  -  tr(yl)I]C  (B.ld) 

which  is  eq((2.5.74a).  Using  J=2  in  eq(2.5.71b) 

Q  =  (-l)0*^2  +  (“l^a-jB1  +  (-l)'2a2B°  (B.2a) 

s  BB  +  k(AA0)%  -  5  triAAjl  (B.2b) 

From  eq(2.5.73a) 

Ax  ^AAq  +  o^I.  (B.3) 

Using  eq(B.3)  in  (B.2b) 

Q  =  BB  +  tr(*A)B  -  \  \i[A(AA0  +  a,I)]I.  (B.4) 

From  eq(2.5.73b) 

•*o  =  I  (B.5) 

and  from  eq(2.5.72a) 

a,  =  MA).  (B.6) 

Using  these  equations  in  (B.4) 

Q  =  BB  +  tr(#A)B  -  \  n[A[A  -  tr(^.)I]}I  (B.7) 
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which  is  eq(2.5.74b).  Using  J=3  in  eq(2.5.71a),  we  have 


P  =  (-iMqCB2  +  +  (-lM2CB°  (B.8) 

Using  eq(2.5.73a),  eq(B.8)  reduces  to 

P  =  CB2  -  \AA0  +  o,I]CB  +  [AA,  +  a2I]C  (B.9a) 

=  CB2  -  [A  ■  trU)I]CB  +  -  tM)I]  -  5  tr(^,)l}C  (B.9b) 

=  CB2  -  [A  -  tr(A)I]CB  +  {A-  -  Au(A)  -  5  tr(^2  -  ^trM)]l)C  (B.9c) 

=  CB2  -  [A  -  tr(A)I]CB 

+  [A2  -  Au(A)  -  'ht(A2)1  +  iu[Au(A)]l}C.  (B.9d) 

From  eq(2.5.77b) 

B2  =  (tiB)B  -  (detB)I  (B.10) 

with  a  similar  expression  for  A  so  that 

P  =  C[(trB)B  -  (detB)U  -  [A  -  (tnA)I]CB 

+  { (tr A)A  -  (det*4.)I  -  A(trA)  -  \  tr[(tr*4)»4]I 
+  \  tr[(deU)I]T  +  2  tr[*4tr(»4.)]l}C.  (B.ll) 

Since 

tr[(deU)I]  =  [J(det**)I]  =  3(det^)I,  for  J=3,  (B.12) 

then 

P  s C[(tiB)B  -  (detB)I]  -  *4.CB  +  [trsAjCB  +  {-(deU)I  +  f(deU)l)C  (B.13a) 
=  [tr A  +  tiB]CB  -  C(detB)  -  ylCB  +  \  (detyl)C  (B.13b) 

=  [tiA  +  trB]CB  +  [\  (deU)  -  (detB)]C  -  ACS  (B.13c) 

which  is  eq(2.5.84a).  Similarly,  eq(2.5.71b)  for  J=3  yields 

Q  =  (-l)0^3  +  (-l)lt*iB2  +  (-l^B1  +  (-l)3a3fi°  (B.14a) 

=  B3  -  [-  tr(^0)]B2  +  [-  \  tr(^!)]B  -  [-  \  lr(AA2))l  (B.14b) 
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=  B3  +  [tr(**)]B2  -  \  tr {A[AA0  +  c^l]  }B 

+  5  tr {A[AAX  -  \  tK^i)I]}I  (B.14c) 

=  B3  +  [tr(^)]B2  -  \  trGA2)B  -  5  tr{yl[-tr(A))}B 

+  \ tr{ A2[AA0  +  ajl] } I  -  gtr{*tr{*[*W0  +  (B.14d) 

=  B3  +  [tr(^)]B2  - 1  tr(yl2)B  +  5  (xiA)2*  +  \  tr(A3)I 

+  \  -  gtr{»4.[tr(<^.2)]}I  -  gtr{Atr[«A(-tr^)}I  (B.14e) 

=  B3  +  (tr(**)]B2  -  \  tr(^2)B  +  \  (tr Afb  +  \  tr(yl3)I 

-  \  tr(yl2)tr(^)I  -  gtr(yl)tr(A2)I  +  g  [trA]3I  (B.14f) 

=  B3  +  [tr(^)]B2  -  \  tr(^.2)B  +  \  (tr A)2^  +  \  tr(^3)I 

-  \  tr(^2)tr(^)I  +  I  [tr^]3I.  (B.14g) 

However, 

B2  =  (trB)B  -(detfi)I  (B.15) 

with  a  similar  expression  for  A  so  that 


‘  Q  =  (tiB)B2  -  (detB)B  +  (tryl)B2  -  \  tr((tr^)^  -  (det**)I]B  +  \  (tr A)2* 

+  \  tr{»4.[(tr*4.)*4.  -  (detail }  *  \  tr[(tr»4)»4.  -  (det*4.)I]tr(»4.)I 

+  g[try*]3I.  (B.16a) 

=  (tr (A)  +  tr(B)]B2  -  (detB)B  -  5  (tr=A)2B  +  5  tr[(det**)I]B  +  \  (tr^.)^ 

+  \  (tr»4.)tr(»4.2)I  -  \  tr{  (det*4.)I }  I  -  j(tr*4.)2I  +  \  tr[(det*4.)l]tr(y4)I 

+  g(tryl]3I.  (B.16b) 

Using  eq(2.5.79b) 

Q  =  [tr (A)  +  tr(B)]B2  -  (detB)B  -  \  (tryl)2B  +  \  tr[(deU)I]B  +  \  (tr^)^ 

+  ^  (irA)[(tvA)2  *  tr(det*4.)]I  -  3  tr{(deu4.)l}l  -  ^(tr*4)2I 

+  \  tr[(det^)l]tr(yl)I  +  g  (trylj3!.  (B.17a) 
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=  [tr(^)  +  tr(B)]B2  -  (detB)B  +  \  tr[(det**)I]B  +  \  (tr^)tr(deU)I 

-  \  tr(det^)I  -  i(trA)2l  +  \  [irAfl  (B.17b) 

Using  eqs(B.12)  and  (B.15)  in  (B.17b)  and  collecting  terms 


Q  *  [tr^+tiB][(trfi)B-(detB)I]  -  (detB)B  +  \  (det^)B  +  \  (try*)(dety*)I 


(deU)I  -  %trA)2l  +  5  [tn*]3! 


(B.18) 


which  is  eq(2.5.84b). 


APPENDIX  C 


DERIVATION  OF  CONSTRAINT  ON  |pg„|  FOR  A  GAUSSIAN 
SHAPED  CROSS-CORRELATION  FUNCTION 

In  this  appendix,  we  derive  the  constraint  expressed  by  eq(4.4.4).  We 

consider  the  specific  example  of  the  Gaussian  shaped  cross-correlation  function. 

Let  us  define  3C0..  such  that 
g‘J 

Xgij  "  lpgijl<Tgiiagjj  (C1) 

(C.2) 

(C.3a) 
(C.3b) 

!•  follows  that 


and  use  this  expression  in  eq(4.3.6)  so  that 
^ expue  (|)]. 

With  reference  to  eq(4.3.3),  note  that 
IR„  (1)1  =  1R*  .,(1)1 


e„..(i)  =  -e„..(-i). 
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Inserting  eqs(C.2)  and  (C.4)  in  constraint  eq(4.4.3),  we  obtain 


exp[j0g..(l)j 


K...(Xs..)(-|+lgij)2  T 

+  — 11 — u— 2 -  exp[-j0g..(l)]  <  40&,0g... 

( V'*ij  J 


(C.5) 


Noting  that  (-1  +  le..)z  =  (I  -  lg  )  ,  we  have 


■gij 


4^gii)2(^ii)2('-'e.j)2 


2  2 


c°s2[Qg„(|)]  <  4oguogij 


(C.6) 


so  that  from  eq(C.l), 


(Xg.j)21^ 


y 


COS2[0e..(l)]  <  1. 


gy 


(C.7) 


The  most  stringent  condition  for  this  constraint  equation  occurs  when 
that 

2  (>-gii)2lgii 
5  cos2[egij('gij)]' 


=  L.  ,  SO 

g»J 


(C.8) 


Taking  the  square  root  of  both  sides  of  this  equation,  we  have  the  constraint 


^giAj _ 

lp*ijl "  *  lcos[eg..(ig..)]l 


(C.9) 
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Since  Ipg J  is  positive,  we  have 


(xjiij 


(C.10) 
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APPENDIX  D  DERIVATION  OF  EQ(5.2.3) 

In  this  appendix,  we  derive  the  expression  for  the  variance  of  ftjjT(l,N) 

expressed  by  eq(5.2.3).  Consider  the  biased  time-averaged  estimate  of  the 
autocorrelation  function;  ie., 

Rj.-1-l 

^  Ixi(n)x*(n-I)  0<l  <Nt-1 

(D.l) 

X^x*(n)Xj(n-lll)  -(NT-1)  <1  <0. 

where  the  symbol  a  in  this  discussion  designates  the  quantity  as  an  estimate.  Let 

<|>(n,l)  =  Xj(n)xi  (n  - 1).  (D.2) 

Assuming  stationarity,  the  covariance  of  <|>(n,l)  can  be  expressed  as 

CM(k,l)  =  E[{<t>(n,l)-E[<Kn.l)] )  { 0*(n-k,l)  -  E(0*(n-k,l)] )  ] 

=  E[<t»(n,l)<()*(n-k,l)]  -  E[0(n,l)]E[0*(n-k,l)J 

-  E[«t>(n,l)]E10*(n-k,l)]  +  E[0<n,l)]E[0*(n-k.l)] 

=  R^(k,l)  -  E[0(n,l)]E[0*(n-k,l)] 

where 

R^(kJ)  *  E[0(n,l)4>*(n  -  k,l)].  (D.4) 

Assuming  stationarity,  we  have  from  eq(D.2), 


(D.3a) 

(D.3b) 

(D.3c) 
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E[<Kn,l)]  =  Ru(l) 


(D.5a) 


and 

E[<(>*(n-k,l)]  =  R’(l)  (D.5b) 

so  that 

Cw(k,l)  =  Rw(k,l)  -  lRu(l)l2  (D.6a) 

=  Etxj^Xi  (n  -  l)X{  (n  -  k)xj(n  - 1  -  k)]  -  IR^I)!2.  (D.6b) 

Now  consider  the  variance  of  the  complex  estimate  ftiiT(l,N)  which  can  be 
expressed  as 

Vjj(I.N)  =  E  { [feiiT(l,N)-E(ftUT(l,N)]][ftiiT(l,N)-E[ftUT(l,N)]]  }  (D.7a) 

=  E[feiiT(l,N)ftUT(I.N>]  -  E[ftUT(l,N)]E[fti;j(l,N)].  (D.7b) 

Using  eq(D.l)  for  positive  and  negative  I,  we  have 


£,i^(I.NX$uTb(l,Nx)  = 


Nrl-1  Nr  I- 1 

X  X  xi(n)xi(n-l)xi(p)xi(p-l) 

n=0  p=0 


0  < I  <  NT  -  1 


Hrll|- 


X  x  i  (n)xi(n-lll)xi(p)xj  (p-lli) 

p=0 


'(Nt  -1)  <  I  <  0 


(D.8) 


so  that 
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■ — W ’ff*”  ",'1 


E[ftiiTb(l,NT)ftii;b(l,Nx)  ]= 

Nt-I-1  Nrl-1 

-3  Z  E  E[xi(n)xi(n-I)xi(p)xi(p-I)]  0£  NT  -1 

Nj  n=0  p=0 

(D.9) 

Nt-II|-1Nt-II|-1  , 

-4  £  X  E[xi(n)xi(n-lll)xi(p)xi(p-ltl)]  -(Nrl)  S  I  S  0. 

Nt  n=0  p=0 


Also, 

i 

^  X0  Riid)  0  £  I  £  Nt  -  1 

e[<w-nt>i=  ;;I1M 

I  Ru(i)  -(Nt-u<;i<;  o 

v-  T  n=0 

so  that 

E[6iiTb(|.NT>]E[^)(I.NT)]  = 

Nrl-1  Nrl-1 

^2  I  I  iRiid)!2  0  S  I  £  nt 

Nj  n=0  p=0 

Nrll|-1  Nt-II|-1 

Z2  I  I  lRii(l)l2  -(NT-l)£l£0. 

Nt  n=0  p=0 


Using  eqs(D.9)  and  (D.l  1)  in  the  expression 

VBj .(I,Nt)  =  E[£uTb(l,NT)A,nb(l,NT)]  -  E[^iiTb(l,NT)]E[^u;b(l,NT)]  (D.  1 2) 

we  obtain 


(D.10) 


(D.l  1) 
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vb..(I,nt)  = 


Nrl-1  Nj-l-1 

~~2  X  X  { E[xi(n)xi  (n-l)xi  (p)Xj(p-l)]  -  IR^I)!2 } 
Nt  n=0  p=0 


for  0  <,  I  £  Nt  -1 

nt-ii|-i  nt-ii|-i  .  . 

-5  I  It  E[X|  (n)xj(n-lll)xj(p)xj  (p-'i;! .  |RU(I)I2 } 
Nt  n=0  p=0 


(D.13) 


for  -(Nt-1)  <  I  <  0. 


Using  eq(D.6b)  in  (D.13) 


r 


Nrl-1  Nrl-1 

X  X  C0A(n  -  p,l) 

n=0  p=0  V 


vBii(i,NT)  = 


X  C4>^(n  '  P’ll') 

p=0 


0  ^  1  <  nt  *  1 


-(Nt-1)  £  I  £  0. 


(D.14) 


We  now  let  k  =  n  -  p  where 


-(Nt  - 1  - 1)  £  k  £  Nt  - 1  -  1 

for 

0^I$Nt-1 

(D.15a) 

-(NT-lll-l)£k£NT-lll-l 

for 

-(Nrl)£l£0. 

(D.15b) 

We  also  note  that  eq(D.15b)  is  equivalent  to  eq(D.15a)  for  negative  values  of  I  so 
that 
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4*  •  -  ;.1?h‘^  .‘<4-  -  ^4  -~*iHL£'  .  -  V-  rH’ *•  -  ,■**.  --fc 


-V^*’ ' 


VBiiO.NT)  = 

Nt-II|-1 

-4  I  [nt  -  III  -  Ikl]  c(t>4>(k,l)  OSlSNT-l 

Nt  k=-(Nrll(-l) 

=  1  ,  Nrll|-1 

-4  £  [NT- III- Ikl]  C**(k,lll)  -(Nt-1)SIS0. 

Nt  k— (Nrll|-1) 


However,  for  negative  lag  I,  we  have 


C#(k,lll)  =  C*(kJ) 


(D.17) 


so  that  after  dividing  the  bracketed  factor  by  one  of  the  NT  terms  in  the 
denominator 


VBiifl.NT)  =  ~ 


Nrl 


Tk, 


lc=-(Nrl!|-l) 


C^Ck,!) 


(D.18) 


for  both  positive  and  negative  values  of  I.  In  Appendix  G,  we  show  that  the 
imaginary  terms  in  C^Ck.l)  cancel  when  summed  over  positive  and  negative 

values  of  k  so  that 


vB..(l,Nx)  = 


Ml-i 

K  I 

k=-(NT-H|-l> 


l!J~]Re{Cw(k,l)}. 


(D.19) 
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APPENDIX  E  DERIVATION  OF  EQ(5.2.4) 
In  this  Appendix,  we  derive  eq(5.2.4).  From  eq(5.2.2a) 


E[<|>(n,l)]  •  RU(I) 

(E.la) 

and 

E[<fr*(n-k,l))  =  Rjj(l) 

(E.lb) 

so  that  from  eq(5.2.2d) 

(H.2) 

And  so,  eq(5.2.3c)  becomes 

NT-H|-i 

Vb..(I,Nt)  -  J  2  1  -  'irr  [R**(k.l)  -  lRii(l)l2). 

11  Tk=-(NT-ll|-l)L  T  J 

(E.3) 

We  now  consider 

RM(k,l)  =  E[<ti(n,l)<t>*(n  -  k,l)] 

(E.4a) 

jfl  )|( 

=  E[xj(n)x-  (n  -  l)x-  (n  -  k)x^(n  - 1  -  k)]. 

(E.4b) 

For  processes  with  zero-mean,  jointly  stationary  Gaussian  quadrature 
components  Xjj(n)  and  Xjq(n),  eq(E.4b)  can  be  expressed  as  [see  Appendix  F] 

Rw(k,l)  =  iRijd)!2  +  lRjj(k)l2  +  Fjj(l.k) 

(E.5) 

where 
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Fjjfljc)  =  { R"(l+k)  -  RjP(l+k) }  { Ra(l-k)  -  R^fl-k) } 

+  { Ra'd+k)  +  R |P(l+k) }  ( Rj *(l-k)  +  RiP(l-k) } 

-  j  { Rtt(l+k)  -  R^d+k) }  { R^(l-k)  +  RjP(l-k) } 

+  j  { Ra(l-k)  -  R^l-k) }  { R§‘(l+k)  +  RjPd+k) ) .  (E.6) 

Using  eq(E.5)  in  (E.3),  we  have 

nt-:i|-i 

Vb..(I,Nt)  =  jf  I  1  -  1 [|Rii(k)l2  +  Fu(U)].  (E.7) 

11  Tk=-(FT-ll|-l)L  T  J 

By  examination  of  eq(E.6),  we  note  that  the  imaginary  terms  in  eq(E.7) 
sum  to  zero.  This  can  be  seen  by  first  noting  that  Fjj(l,k)  is  real  for  k=0.  We  also 

note  that  imaginary  terms  evaluated  with  negative  values  of  k  serve  to  cancel  the 
corresponding  imaginary  terms  for  positive  values  of  k.  And  so,  only  the  real 
part  of  the  function  Fjj(l,k)  contributes  to  the  VB..(I,NT)  function.  Therefore, 

N  -|||- 1 

VBii(I.NT)  =  ff  \  1  -  IIJwrl  [lRii(k)l2  +  Re{Fii(l,k))]  (E.8) 

Tk=-(NT-ll|-l)L  T  J 

which  is  eq(5.2.4)  in  the  text.  In  Appendix  G,  it  is  shown  that 

Fu(U)  =  E[Xj(n)Xj(n  - 1  -  k)]E[x*  (n  -  l)Xi  (n  -  k)].  (E.9) 
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APPENDIX  F  DERIVATION  OF  EQ(E.5)  IN  APPENDIX  E 


In  this  appendix,  we  derive  eq(E.5)  of  Appendix  E.  Consider  eq(E.4b) 
expressed  as 


*  * 

R<jMj>(k,l)  =  Elxjfa^  (n  -  l)xj  (n  -  k)xj(n  - 1  -  k)]. 


(F.l) 


In  the  special  case  where  the  process  Xj(n)  is  complex  Gaussian,  then  [167] 

R<jx|>(k*l)  ~  E[xj(n)xj  (n  -  l)]E[Xj  (n  -  k)xt(n  - 1  -  k>] 

+  E[xi(n)xi  (n  -  k)]E[Xj  (n  -  Ox^n  - 1  -  k)].  (F.2) 

where  use  has  been  made  of  the  fact  that  E[Xj(n)Xj(k)]s=0  for  n*k.  However,  we 

do  not  wish  to  constrain  this  discussion  to  this  restrictive  case.  Rather,  we  wish 
to  consider  the  more  general  case  of  a  Gaussian  process  x^n)  with  unconstrained 

quadrature  components.  We  therefore  consider 

Xj(n)  «  xu(n)  +  j  xiQ(n)  (F.3) 

where  the  processes  Xjj(n)  and  x^Q(n)  are  jointly  Gaussian.  Using  eq(F.3)  in 
(F.l),  we  obtain 

R^(k,l)  =  E{  [XjjCn)  +  j  Xiq(n)][Xii(n-l)  -  j  xiQ(n-l>] 

.  [xji(n-k)  -  j  XjQOi-kWx^n-l-k)  +  j  xiQ(n-l-k)] }  (F.4a) 

=  E  { [xiI(n)xiI(n-l)+xiQ(n)xiQ(n-l)+jxiQ(n)xiI(n-l)-jxiI(n)xiQ(n-l)] 

.  [xiI(n-k)xiI(n-l-k)+xiQ(n*k)xiQ(n-l-k) 

+jxii(n-k)xiQ(n-l*k)  -  jx^n-tyx^n-l-k)] }  (F.4b) 
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=  E[xiI(n)xiI(n-l)xiI(n-k)xiI(n-l-k)]  +  E[xiQ(n)xiQ(n-l)xiI(n*k)xiI(n-l-k)] 

+  E[xiI(n)xiI(n-l)xiQ(n-k)xiQ(n-l-k)]  +  E[xiQ(n)xiQ(n-l)xiQ(n-k)xiQ(n-l-k)] 

-  E[xiQ(n)xiI(n-l)xiI(n-k)xiq(n-l-k)]  +  E[xiI(n)xiQ(n-l)xiI(n-k)xiQ(n-l-k)] 

+  EtXjQ^XijCn-DxiQCn-^Xi^n-l-k)]  -  E[xiI(n)xiQ(n-l)xiQ(n-k)xiI(n-l-k)] 
+jE[xiI(n)xiI(n-l)xiI(n-k)xiQ(n-l-k)]  -  jE[xiI(n)xiI(n-l)xiQ(n-k)xiI(n-l-k)] 
+jE[xiQ(n)xiQ(n-l)xiI(n-k)xiQ(n-l-k)]  -  jE[xiQ(n)xiQ(n*l)xiQ(n-k)xiI(n-l-k)] 
+jE[xiQ(n)xiI(n-l)xiI(n-k)xiI(n-l-k)]  +  jE[xiQ(n)xiI(n«l)xiQ(n-k)xiQ(n-l-k)] 
-jE[xiI(n)xiQ(n-l)xiI(n-k)xiI(n-l-k)]  -  j  E[xiI(n)xiQ(n-l)xiQ(n-k)xiQ(n-l-k)] 

(F.4c) 

For  Gaussian,  zero-mean  quadrature  components,  eq(F.4c)  can  be 
expressed  as 

Rw(k,l)  =  [R"(l)]2  +  [R"(k)]2  +  r"(I  +  k)R"(k  - 1) 

+  R^dJRud)  +  [R?'(k)]2  +  R?‘(l  +  k)R?'(k  - 1) 

+  RudJR^I)  +  [RiP(k))2  +  RlPd  +  k)R|P(k  - 1) 

+  (R^d)]2  +  (R^dc)]2  +  R^d  +  k)R?°(k  - 1) 

-  Ru‘(l)RjPd)  -  R^WiPdc)  -  R^d  +  k)Ra (k  - 1) 

+  [RlPd))2  +  RaOOR^k)  +  r’uQ(I  +  k)R^‘(k  - 1) 

+  [Ru'(l))2  +  R^(k)R"(k)  +  R§‘d  +  k)R|P(k  - 1) 

-  R'iPd)Rf(l)  -  RS?(k)Ru ‘(k)  -  R? d  +  kJR^k  - 1) 

+j  (  r"(I)r!P(I)  +  R°(k)RlP(k)  +  Ra9(l  +  k)R"(k  - 1) } 

-j  {RfiWa'd)  +  Rp(k)Ra(k)  +  R“d  +  k)RiP(k  -  0) 
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+j  { R  a^ORiPd)  +  R? ' WaV)  +  R^fl  +  k)R?’(k  - 1)  j 
-j  {R^Q(l)Rf  (I)  +  Ra^(k)R?*(k)  +  R?'d  +  lOR^Oc  - 1)} 
+j  { R#  Wad)  +  R? 1 '(k)Ra(k)  +  R§'(l  +  k)Ra(k  - 1) } 

+j  { R^dJR^d)  +  R j?Wi?(k)  +  Ra°(l  +  k)RjP(k  - 1) } 

-j  { RaWad)  +  Ra(k)Ra‘(k)  +  Rad  +  k)R$‘(k  - 1)} 

-j  { RiPdJRa^O)  +  RIa<5(k)RaQ(k)  +  Ra*d  +  k)Ra°(k  - 1) } 


where  we  note  that  the  first  two  terms  in  each  parenthesis  for  the  imaginary 
terms  cancel.  Since 

Rd)  =  [Rad)  +  R^d)]  +  j  (Ra ’d)  - Rpd)]  (F.6) 


|R(I)I2  =  [Rad)]2  +  2Rad)R§Q(l)  +  [R?°(l)]2 

+  (R^d)]2  -  2R^(l)R]Pd)  +  [rLQ(032  (F.7) 

and  similarly  for  lR(k)l2  so  that 

R#(k)  =  iR^Dl2  +  lRu(k)l2  +  Fu(l,k)  (F.8) 


where 
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Fjj<l.k)  =  { R"(l  +  k)  -  Rjftl  +  k) }  {  rSSo  -  k)  -  R^l  -  k) } 

+  ( Ra‘(l  +  k)  +  R-f  (I  +  k) }  { R§'(l  -  k)  +  Rjf (I  -  k) ) 

-  j  { R*a(l  +  k)  -  R§°(l  +  k) }  { R?'(l  -  k)  +  Rif  (I  -  k) ) 

+  j  {  r'S(I  -  k)  -  RfQ(l  -  k) }  { R§'(l  +  k)  +  Rl?(l  +  k) }  (F.9) 

as  noted  in  eq(E.6)  of  Appendix  E. 
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APPENDIX  G  DERIVATION  OF  EQ(E.9)  IN  APPENDIX  E 


In  this  appendix,  we  show  that  the  term  Fjj(l  Jc)  in  eq(E.9)  is 

Fu(l,k)  =  E[xi(n)xj(n  - 1  -  k^Efy  (n  -  l)xj  (n  -  k)].  (G.l) 


Expressing  the  process  Xj(n)  in  terms  of  its  quadrature  components 
Etxj^XjCn  - 1  -  k)]  = 


=  E  { [xn(n)  +  jxiQ(n)][xiI(n  - 1  -  k)  +  jxiQ(n  - 1  -  k)] } 

(G.2a) 

=  {  r"(I  +  k)  -  r2Q(I  +  k) }  +  j  { R§'(1  +  k)  +  r!?(I  +  k) ) 

(G.2b) 

and 

*  * 

E[xj  (n  -  l)xi  (n  -  k)]  = 

=  E{  [xa(n  - 1)  -  jxiQ(n  -  !)][xn(n  -  k)  -  jxiQ(n  -  k)] } 

(G.3a) 

=  { Ra(k  - 1)  -  R?Q(k  - 1) )  -  j ( R?‘(k  - 1)  +  RjP(k  - 1) ) 

(G.3b) 

But 

TT  T  T 

Ru(k  •  1)  =  R"(l  -  k) 

(G.4a) 

R^Q(k  - 1)  =  R?Q(I  -  k) 

(G,4b) 

Ra'(k  - 1)  =  R-Q(l  -  k) 

(G.4c) 

R|P(k  - 1)  =  Ra"(l  •  k) 

(G.4d) 

so  that  eq(G.3b)  becomes 
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E[x‘(n  -  l)x*(n  -  k)]  = 

=  {  r"(I  -  k)  -  R^Q(I  -  k)}  -  j  { R§‘(l  -  k)  +  r'iPo  ■  k)} .  (G.5) 

Substituting  eqs(G.2b)  and  (G.5)  into  (G.l),  we  obtain 

Fii(U)  =  { R"(l  +  k)  -  R?Q(I  +  k) }  { R?(l  -  k)  -  R?Q(I  -  k) } 

+  { R?'d  +  k)  +  R-Pfl  +  k) }  { R?‘(l  -  k)  +  R!iP(l  -  k) ) 

-  j  { Ru(l  +  k)  -  R§Q(I  +  k) }  { R?'(l  •  k)  +  R'iP(l  -  k) } 

+  j  {  r"(I  -  k)  -  R^Q(I  -  k) }  { R?'(l  +  k)  +  R|P(I  +  k) ) .  (G.6) 

In  Appendix  E,  we  noted  that  when  eq(G.6)  was  used  in  eq(E.7),  the 
imaginary  terms  summed  to  zero.  This  was  shown  by  first  noting  that  Fjj(l,k)  is 

real  for  k=0.  We  also  note  that  imaginary  terms  evaluated  with  negative,  values  of 

k  serve  to  cancel  the  corresponding  imaginary  terms  for  positive  values  of  k. 
And  so,  only  the  real  part  of  the  function  Fjj(l,k)  contributes  to  the  function 

VB^(I).  If  the  corresponding  bandpass  processes  are  stationary  and  narrowband, 
then  (see  ref  [3],  section  III.E.2.a), 

R° (a)  =  R uQ(a)  all  a  (G.7a) 

and 

R?(a)  =  -  RiP(a).  alia.  (G.7b) 

Using  eqs(G.7)  in  (G.6),  we  obtain  Fjj(l,k)  -  0,  In  this  case,  eq(5.2.4) 
reduces  to  eq(5.2.8). 
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APPENDIX  H  CONSIDERATION  OF  THE  TERMS  Fy(l,k)  AND 
Rjj(k)Rj*j(k)  IN  EQS(5.2.19)  AND  (5.2.20) 

* 

In  this  appendix,  we  consider  the  terms  Fjj(l,k)  and  Rji(k)Rjj(k)  in 
eq(5.2.19).  Consider, 

Fij(l,k)  =  E[Xi(n)xj(n  - 1  -  k)]E[x- (n  -  l)x*(n  -  k)].  (H.l) 

Expressing  the  processes  Xj(n)  and  Xj(n)  in  quadrature  form,  we  have 

E[xj(n)xj(n  - 1  -  k)]  = 

=  E  { [xn(n)  +  jxiQ(n)][xj1(n  - 1  -  k)  +  jxjQ(n  - 1  -  k)] }  (H.2a) 

=  { R*j(l  +  k)  -  R?Q(I  +  k) }  +  j { R^O  +  k)  +  R-Q(l  +  k) )  (H.2b) 

and 

E[xj  (n  -  l)xj  (n  -  k)]  = 


=  E  { [Xj!(n  - 1)  -  jxJQ(n  -  l)][xu(n  -  k)  -  jxiQ(n  -  k)] }  (H.3a) 

=  { R?(k  - 1)  -  R j?Q(k  - 1) )  -  j }  R  (k  - 1)  +  RjP(k  - 1)1  ■  (H.3b) 

But 

R?(k  - 1)  =  r"(I  -  k)  (H.4a) 

Rj?°(k  ■  I)  =  R^l  -  k)  (H.4b) 

Rji'(k  - 1)  =  Ri^d  -  k)  (H.4c) 

RjP(k  - 1)  =  R?  (I  -  k)  (H.4d) 

so  that  eq(H.3b)  becomes 
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E[xj  (n  -  l)xj  (n  -  k)]  = 

=  {  r"  (I  -  k)  -  Rfd  •  k) }  -  j  ( R$'(l  -  k)  +  R-j^Cl  -  k) } .  (H.5) 

Substituting  eqs(H.2b)  and  (H.5)  into  (H.l),  we  have 

Fij(U)  =  ( R"(l  +  k)  -  R^l  +  k) }  {  r“ (I  -  k)  -  R^Q(I  -  k) } 

+  {Rjfd  +  k)  +  R’fd  +  k)}  {Rf'd  -  k)  +  RiP(l  -  k)} 

-j  (Ryd  +  k).  R^Qd  +  k)}  {Rf  (I  -  k)  +  R^(l  -  k)} 

+  j  {  r"(I  -  k)  ■  R?Q(I  -  k)}{  R*fd  +  k)  +  RiPd  +  k) ) .  (H.6) 


By  examination  of  eq(H.6),  we  note  that  the  imaginary  terms  sum  to  zero  when 
Fjj(l.k)  is  substituted  into  eq(5.2.19).  We  now  consider  the  term  Rjj(k)Rjj(k)  in 

eq(5.2.19);  ie., 

Rii(k)Rjj(k)  =  E[xi(n)x,  (n  -  k)]E[xj  (n  -  l)xj(n  - 1  *  k)].  (H.7) 

Now 

E[Xj(n)Xj(n  -  k)]  = 

=  E  { txu(n)  +  jxiQ(n)] [xu(n-  k)  -  jxiQ(n-  k)] }  (H.8a) 

=  { R"(k)  +  R^k) )  +  j  { R?’(k)  -  RiP(k) )  (H.8b) 


and 


E[xj  (n  -  l)xj(n  - 1  -  k)]  = 

=  E  { [Xjj(n  - 1)  -  jxjQ(n  - 1)]  [Xjj(n  - 1  -  k)  +  jxjq(n  - 1  -  k)]  (H.9a) 


279 


=  { R?(k)  +  R^(k) )  -  j  { R$'(k)  -  Rjp(k) } . 


(H.9b) 


And  so 

Ru(k)R*(k)  =  {  r" (k)  +  RsV) }  {  r" (k)  +  R^(k) } 

+  { R§‘(k)  -  R'jPoc) )  ( Rj‘(k)  -  Rj?(k) } 

-  j  { Raflc)  +  R^k) )  { R-f  (k)  -  Rjp(k) ) 

+  j  { Rj|(k)  +  R^(k) }  { R?’(k)  -  RjP(k) ) .  (H.  10) 

Consider  the  imaginary  terms 

Im { Rjj(k)Rjj(k) }  =  -j  R^OOR?1  (k)  -j  R§Q(k)R?' (k)  +  j  R^Wf^) 

+j  R^lklR^k)  +  j  R"{k)R?'(k)  +  j  R^kjR^Vk) 


-  j  RjjWiPflc)  -  j  R^OOR’jPlk). 

(H.ll) 

We  now  recall  that 

R?(k)  =  R"(-k) 

(H.12a) 

R?Q(k)  =  R?°(-k) 

(H.l2b) 

Ru'(k)  =  R^(-k) 

(H.12c) 

R^(k)  =  R?‘(-k) 

(H.12d) 

* 

with  equivalent  expressions  for  the  j  channel  processes.  When  Ri}(k)Rjj(k)  is 

used  in  the  summation  of  eq(5.2.19),  we  recognize  that  the  terms  in  eq(H.ll)  will 
cancel  when  the  positive  and  negative  k  values  are  determined.  For  example,  the 
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first  term  in  this  equation  becomes  -j  R^(k)RjP(k)  when  k  is  negative.  This  term 

will  cancel  the  third  term  in  the  equation  for  k  positive.  Similarly,  the  other 
terms  cancel.  It  is  concluded  that  all  of  the  imaginary  terms  in  eq(5.2.19)  sum  to 
zero  and,  therefore,  need  not  be  considered. 

Finally,  we  note  that  if  the  corresponding  bandpass  processes  are  jointly 
stationary  and  narrowband,  then  (see  Appendix  0), 

R°(a)  =  RjfV)  (H.13a) 

and 

Rf  (a)  =  -RljW  (H.13b) 

Using  these  equations  in  eq(H.6),  we  obtain  Fy(l,k)  *  0.  In  this  case,  eq(5.2.19) 
reduces  to  eq(5.2.20). 
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APPENDIX  I 

SIMPLIFICATON  OF  EQ(6.3.27)  IN  THE  SPECIAL  CASE  OF 
STATIONARY  BANDPASS  PROCESSES 


In  this  appendix,  we  prove  that  the  likelihood  ratio  of  eq(6.3.27)  reduces  to 
that  of  eq(6.1.26)  for  the  special  case  where  the  auto-  and  cross-correlation 
sequences  of  the  quadrature  components  satisfy  the  specific  constraints  given  by 
eq(6.3.28).  From  eqs(6.3.26)  and  (6.1.25),  we  have 


ST(nlH,)(K[(nln-lrHi)]'14(nlH,) 

i  =  0,1 


(1.1) 


J  lYi(nlHj)l2 

I  2 - =  £H(nlHi)(Kx(nln-l,Hi)rI£(nlHi) 

j=l  a7j(nlH,) 

J 


i*0,l 


(1.2) 


For  the  special  case  where 

Rx(HHi)  =  R^IIHj)  i  =  0,1  (I.5a) 

and 
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(1.5b) 


R?(HHi)  =  -  R^IIHj) 


i  =  0,1. 


In  Appendix  M,  we  show  that  when  eqs(1.5)  hold,  we  have 


R?(0IHi)  =  R^COlHj) 
R?(0Hi)  =  -  RjPcOlHi) 


i  =  0,1 


i  =  0,1 


(I.6a) 

(I.6b) 


and  the  identically  equivalent  relations 


R^(OIHj)  =  R^(OIHi) 


i  =  0,1 


(I.7a) 


QI  IQ 

Re  (OlHj)  =  -  Re  (OlHj) 


i  =  0,1. 


(I.7b) 


In  this  case,  we  have  from  eqs(1.3)  and  (1.4) 


K/nln-l.Hi)  = 


Re(OIHj)  -Rg^OlHj) 
Rc^OlHj)  R^(OIHi) 


i  =  0,1 


(1.8) 


[Kx(nln-l,Hj)]  =  IR^OlHj)  +  j  IR^OlHi) 


i  =  0,1. 


(1.9) 


Expanding  eq(I.l),  we  have 


i  [yjA(nlHj)]2  (VjB(nlHi)]2  T 

>  — J — s - + — J ~ - =  e 

j=1  ^Oa  <NoB 


S1  (nlHi)[Kr(nln- 1  ,Hi)]"1e(nlHi)  i  =  0,1  (1.10a) 
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■  feftnlHj)  sJfnlH;)]  QI 


Rj(OIHi)  R^(OIHj) 


R?'(OIHj)  R^roiHj) 


£,(nlHj) 

L^nlHj) 


=  tsftnlHj)  SQ(nlHj)] 


Kri,Kri  T^nWi) 

LK'2.Kr22Wn|Hi) 


i  =  0,1 


i  =  0,1 


where 


R?(OIHj)  R^(OIHj) 
R^'fOlHj)  R^OlHj) 


and,  from  the  matrix  inversion  lemma  [95,  pg.  25] 


[Kr  K,  1 

rll  M2 

Kr  K, 

II 

L  r2l  r22  J 

L 

i  =  0,1. 


Kru  =  {  r"(0)]  -  (R|.Q(0)][R?Q(0)]',(Rj1(0)])'1 
K,i2  =  -{R"(0)1  -  [ReQ(0)][R^(0)]'1[Rel(0)]}1[R(P(0)][R^<\o)]‘l 
Kr21  =  -{R?Q(0)]  -  [ R?'(0)][R“(0)]- 1  [RLQ(0)] } ' ' [R®‘(0)][ R°(0)] - ' 
Kr22  =  (R^O)!  -  lR?1(0)][R2(0)l'1[Ri.Q(0)]}  '. 


In  the  special  case  where  eqs(1.7)  hold 

Krn  =  {  Re(0)]  +  rR?I(0)][Re(0)]*1[R^I(O)]  j1 
Krj2  =  { Re(0)]  +  [R?I(0)][R2(0)]-,[R?I(0)]}'1[R?I(0)][Re(0)]1 
=  Krn[R?I(0)][R°(0)r1 

Kr2j  =  -{R"(0)]  +  [R?!(0)]  [R°(0)]- 1  [^(0)] }  * 1  [R?!(0)]  [r2(0)]'  1 
=  -Krn[R?,(0)][R“(0)r1  =  -Kri2 


(1. 10b) 

(1. 10b) 

(I-ll) 

(1. 12a) 
(1. 12b) 
(1.1 2c) 
(1.1 2d) 

(1. 13a) 

(I.13b) 

(1.13c) 
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Krjj  =  { R"(0)]  +  fR?1(0)][Re(0)]',[R?,(0)] }  1  =  K^. 


(1. 13d) 


And  so 


+  SQlnlHiJK^SilnlHj)  +  £Q(nlHi)KT|  ^(nlHj).  (1.14) 

Expanding  eq(L2),  we  have 
J  lYi(nlHj)l2 

X  J2  -  =£H(nlHi)[Kx(nln-l.Hi)l1£(nlHi)  i  =  0,1  (I.15a) 

j=l  Oy.CnlHj) 

=  (&T(nlHi)  -  j£Q(nlHi)](Kx(n!n-l,Hi)]  l[£I(nlHi)  +  j^OilHj)]  1=0,1.  (1.15b) 

We  now  expand  the  matrix  [K^nln-l.Hj)]’1.  Let 

A  =  A,  +  jAQ  (1. 16a) 

and 

A'1  =  Bt  +  jBQ.  (1.1 6b) 

Then 

A'1  A=  [Bj  +  jBQ]  [A,  +  jAQ]  =  I.  (1.17) 

It  follows  that 

B,  ArBQ  Aq  =  I  (I.18a) 
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Bq  Ai  +  Bj  Aq  =  0 

(1.1 8b) 

Bq  Aj  =  -  Bj  Aq 

(I.18c) 

and 

Bq  =  -  Bj  AqAj  . 

(I.18d) 

Using  eq(I.18d)  in  (1. 18a),  we  obtain 

Bj  Aj  +  Bj  AqA/Aq  =  Bj  f  Aj  +  AqA/Aq]  =  I 

(1.19) 

so  that 

Bj  =  [Aj  +  AqAj  Aq]*1 

(I.20a) 

and 

=  •  [Aj  +  AqAj  Aq]  1  AqAj1. 

(I.20b) 

Let 

A  =  [Kx(nln-l,Hi)]. 

(1.21) 

From  eq(1.9) 

ii 

Aj  =  2Re(0IHi) 

(I.22a) 

and 

Aq  =  2R^(0IH,) 

(I.22b) 

so  that 

B,  =  [A,  +  AqA]' Aq]'1  =  i  {  Rj(OIHj)  +  RgI(0IHj)[Rj(0IHi)]',Rjl(0IHj) } '' 

(I.23a) 

and 
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Bq  =  -  [A,  +  AqA'i'a^-'A^,'  (L23b) 

=  -  2 { R°(OIHj)  +  R®(OIH1)(r“(OIH,)]-1Rj' (OIH,) } Rj^OlHjXR^OlHj)]'1 


(I.23c) 

=  -  B,  ReVtytR^OlHj))-1  (I.23d) 

Since  eq(1.15)  is  real,  only  the  real  terms  from  the  right  hand  side  of  eq(I.15b) 
need  be  considered.  It  follows  that 

J  lYj(nlHj)l2  T  , 

S  2 - =  £l(nlHi)B[£[(nlHi)  -  SifnlH^B^nlH,) 

j=l  o^(nlHj) 

+  ^(nlHjJB^tnlHi)  +  (1.24) 


In  Appendix  M,  we  show  that  when  eqs(L5)  hold,  the  estimators  i(nln-l.Hj) 
and  iCnln-l.H,)  are  equivalent  so  that 


filW^nlHi) 

i  =  0,1 

(I.25a) 

£Q(nlHi)  =  £Q(nlHi) 

i  =  0,1 

(I.25b) 

R?(0lHi)  =  Rg(OIHj) 

i  =  0,1 

(I.25c) 

R®(OiHi)  =  Re'fOlHj) 

i  =  0,1. 

(I.25d) 

Using  these  relations  in  eqs(1.13)  and  (1.23), 

Bl  =  iKrn 

(I.26a) 

and 

tiQ  =  2  Kfj!- 

(I.26b) 

It  follows  from  eq(1.14)  and  (1.24)  that 
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r[VjA(nlHi)]2  [v|/iB(nlHj)]2l 
2  +  2 

_  - 


.  I  h'i(nlHi)!2 

2  A,  2 

j=l  OyjCnlHi) 


We  now  consider  the  determinant  of  eq(1.3).  From  eq(6.3.23) 

lKr(nln-l  Jl,)l  =  lLy(nlHj)l  lDv(nlHj)l  lL^(nlHj)l  i  =  0,1 
=  lDy(nlH;)l  i  =  0,l 

=  n  d]jA(nlHi)  djjB(nlHi)  i  =  0,1 

J  2  2 

*  II  °  vjA(nlHi)  c\|oB(nlHi)  i  =  0,1. 

Also,  from  eqs(6.1.22) 

IKx(nln-l,Hj)l  =  ILy(nlHi)IIDY(nlHi)IIL^(nlHi)l  i=0,l 

=  ID^nlHi)! 

J  J  2 

*ndy..(nlHi)  =  n^Yi(nlHi)  i-0,1. 
j-l  W  j-1  J 


In  Appendix  N,  we  show  that  in  the  special  case  where  eqs(1.7)  hold, 
IKrCnln-l.Hj)!  =  (5)“  IKx(nln-l,Hi)l2. 


And  so, 

IKr(nln-l,Ho)l  IKx(nln-l,Ho)l2 
IKr(nln-l,H1)l  =  iKx(nln-l,H!)l2  * 


(1.27) 


(I.28a) 

(I.28b) 

(I.28c) 

(I.28d) 

(I.29a) 

(I.29b) 

(I.29c) 

(1.30) 

(1.31) 
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In  this  case,  using  eqs(I.28d)  and  (I.29c)  in  (1.31),  we  obtain 


II  4jA(nlH0)  4B<nlH0>  II  aYj(nlH0> 


0  a^CnlHi)  j^<4j(nlHi) 


Taking  the  natural  logarithm  of  both  sides  of  eq(1.32),  we  obtain 


"  2 

a\WA(nlH0) 

2 

avjB(nlHo) 

j 

‘  2 
oy.(nlHo) 

In  2 

+  In  2 

=  21 

In  2 

<tyjB(n'Hi) 

j-1 

Oy^niHj) 

Using  eqs(1.27)  and  (1.33),  eq(6.3.27)  reduces  to  eq(6.1.26). 


(1.32) 


(1.33) 
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APPENDIX  J 

SIMPLIFICATION  OF  EQ(6.3.36)  IN  THE  SPECIAL  CASE  OF 
STATIONARY  BANDPASS  PROCESSES 

In  the  special  case  where  eqs(6.3.28)  hold,  we  show  in  this  appendix  that 
the  likelihood  ratio  of  eq(6.3.37)  reduces  to  that  of  eq(6.1.38).  From  eqs(6.3.36) 
and  (6.1.37),  we  have 


I  [t -A(nlHi)  +  xL(nlHi)]  =  ^(nlH^K^nln-l^i)]"1^^) 

j=l  J 


i  =  0,1  (J.l) 


^  lotjCnlHi)!2  =  £H(nlHj)[Kx(nln-l  ,H:)]*  ^(nlHj)  i  =  0,1 


(J.2) 


where 


Kr(nln-l,Hj)  = 


Rc(OIHj)  RiQ(0iHi) 
R^(OIHj)  R^OlHj) 


i  =  0,1 


(J.3) 


[Kx(nln-l,Hj)]  =  R^OlHiHR^Wi) +  J ( Re I(0IHi)-R^(0IHi) }  i  =  0,1.  (J.4) 

As  shown  Appendix  I,  for  the  special  case  where 


Rx(HHi)  =  R?Q(liHi) 


i  *  0,1 


(J.5a) 


R^HHi)  =  -  R^llHi) 


i  =  0,1. 


(J.5b) 


Kf(nln-l,Hj)  = 


R?(OIH;)  -Rj'(OIHj) 
R?(«Hi)  rJ(OIHj) 


and 


i  =  0,1  (J.6) 


(Kx(nln-l,Hi)]  =  2R“(0IHi)  +  j2R£,(0IHi)  i  =  0,1.  (J.7) 

Expanding  eq(J.l),  and  following  the  same  discussion  as  presented  in  Appendix  I, 
we  obtain 


I  [t  jA(n|Hi)  +  %(nlHj)]  =  £T(nlHi)[Kr(nln-l,Hi)]-1£(nlHi)  i  =  0,1  (J.8a) 

j=l  1 

=  £i'(nlHi)Krn£1(nlHi)  -  fftnlH^K^OilHj) 

+  fiQtnlHjlK^^nlHj)  +  £Q(nlHi)Kri  ^(nlH;).  (J,8b) 

where 

K,, )  =  { R"(0)1  +  (R?l(0)](R?(0)]'1(R^l(0)] }  •*  (J.9a) 

Kr,2  =  {  Re(0»  +  [ReI(0)][Re(0)]*,[R^I(0)l}*l[Rcl(0)][Re(0)]*1 

=  KI||[R?,(0)][r“(0)]'1  (J.9b) 

Kr2i  =  -  { R"(0)]  +  [R?,(0)][R?(0)1-1[R?‘(0)]}‘1[R?,(0))[rS(0)]-1 

=  -Krii[R?‘(0)][Rj(0)]-‘  (J.9c) 

Kr22  =  (  Re®]  +  (R?,(0)][R°(0)J'i[R^I(0)J  }  ’’  =  Kf]  (J.9d) 


Expanding  eq(J.2),  we  have 
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Xlaj(nlHi)l2  =  £H(nlHi)[Kx(nln-l,Hi)r1£(nlHi)  i  =  0,1  (J.lOa) 

J=1 

=  feftnlH;)  - j£j(nlHi)][Kx(nln-l,Hi)]',[£1(nlHi)  +j£Q(nlHi)]  i=0,l.  (J.lOb) 

Since  eq(J.10)  is  real,  only  the  reA  terms  from  the  right  hand  side  of  eq(J.lOb) 
need  be  considered.  It  follows  uiat 

i  lctj(nlHj)l2  =  £j(nlHi)P  *(nlHi)  -  £iT(nlHi)B(3£Q(nlHi) 

+  £q(iiIH  ^B^falHj)  +  £Q(nlHi)B^Q(nlHi).  (J.  1 1 ) 

where  Bj  and  Bq  are  defined  in  eqs(L23).  However,  as  pointed  out  in  Appendices 
I  and  M,  when  eqs(J.5)  hold,  the  estimators  £(nln-l,Hj)  and  &(nln-i,Hj)  are 
equivalent  so  that 

filCnlHj)  ■  fi^nlHj)  i  -  0.1  (J.12a) 

fiQ(nlHi) «  fiQ(nlHi)  i  *  0,1  (J.12b) 

R^COlHj)  =  Rj(0IHj)  i  -  0,1  (J.12c) 

R^1  (OlHj)  =  Re'(OIHi)  i  =  0,1.  (J.12d) 

In  Appendix  I,  we  also  showed  that 

B,  =  jKrn  <J.13a) 

and 

Bq=  ( J .  1 3b) 

It  follows  from  eqs(J.8)  and  (J.l  1)  that 
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J  2  2  J 

[xjA(nlHi)  +  xjB(nlHi)]  =  2^  locj(nlHi)l2  (J.14) 

We  now  consider  the  determinant  of  eq(J.3).  From  eq(6.3.35) 

lKr(nln-l3i)l  =  ICx(nlHi)IIC^(nlHi)l  i  =  0,1  (J.15a) 

J  J 

=  H  cTA„(nlHi)cra ..(nlHj)  JT  cTA  (nlHi)cTO  (nlHO  (J.15b) 
j=l  JJ  U  j-1  JJ  JJ 

-  n  [WnlHijrtc^JnlHj)]2  i  =  0,1-  (J-15c) 

j=l  -U  JJ 

Also,  from  eqs(6.1.36) 

lKx(nln-l,Hj)l  *  IC^nlHiJlIC^nlHj)  I  i  *  0,1  (J.16a) 

J  J  . 

=  IT  Cajj(nlHi)  Q  caJj(nlHi)  i  *0,1  ( J .  1 6b) 

J 

-  p  lcajj(mHi)l2  i  =  0,1.  (J.  16c) 

In  Appendix  N,  we  show  that  in  the  special  case  where  eqs(J.7)  hold, 

IKr(nln-l,Hj)l  =  021  IKx(nln-l,Hj)l2.  (J.17) 

And  so, 

IKr(n)n-l,H0)l  IKx(nln-l,H0)l2 

IKr(nln-l,Hj)l  =  iK^nln-UHi)!2  '  (J'18) 

In  this  case,  using  eqs(J.15c)  and  (J.16c)  in  (J.18),  we  obtain 
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(J.19) 


Taking  the  natural  logarithm  of  both  sides  yields 

lca..(nlHo)l2' 

In — - 5 

^(nlHi)!2 


N 

I 

n»l 


In 


[cTAi;(nlHo)r  [ctB^n'Ho)] 


il+  In 


IL 


[cTAi4(nlH  x)¥  [cxbJjMx)]4 


N 

“2S, 

n*l 


Using  eqs(J.14)  and  (J.20),  eq(6.3.37)  reduces  to  eq(6.1.38). 


(J.20) 
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APPENDIX  K  ANALYTIC  EXPRESSIONS  FOR  MODEL  I(INCOH) 

AND  MODEL  II(INCOH) 

In  this  appendix,  we  consider  the  development  of  the  analytic  expressions 
for  the  model  I(INCOH)  and  model  H(INCOH)  signals  in  additive  white  noise.  In 
addition,  the  method  used  to  obtain  coherent  integration  curves  for  the  model 
I(COH)  signal  are  described.  Finally,  extensions  are  made  to  the  multichannel 
case. 


K.l  Model  I(INCOH)  Signal  in  White  Noise 

We  now  determine  the  probability  of  detection  for  the  model  I(INCOH) 
signal  in  additive  white  Gaussian  noise  problem.  Let  us  initially  consider  a  pulse 
train  consisting  of  N  pulses  in  which  the  signal  components  are  identical  except 
for  random  initial  phases  which  are  statistically  independent  from  pulse-to-pulse. 
Following  DiFranco  and  Rubin  [13],  we  designate  R.p  as  the  ith  sampled  value 
of  the  matched  filter  envelope  output  where  R.p=2Ep/No  is  the  peak  signal-to- 
noise  ratio,  Ep  is  the  signal  energy  of  each  pulse,  and  the  two  sided  noise  spectral 
density  is  Nq/2( watts/Hz).  Assuming  a  uniform  probability  density  for  the  phase, 
the  probability  density  of  rj  for  a  single  observation  containing  a  sine-wave  signal 
plus  white  Gaussian  noise  is  a  Rician  density  function  expressed  as  [13] 


p(rjl  JLp) 


riexpKrf+Rp)/2]I0(riVV  r^O 

0  rj<  0  . 


(K.l  .1) 


where  I0(*)  is  the  modified  zeroth  order  Bessel  function  of  the  first  kind.  We 

note  that  the  sampling  instant  corresponds  to  the  time  at  which  the  single-pulse 
matched  filter  output  peaks  due  to  the  ith  signal  pulse.  The  sinusoidal  signal  input 
can  be  expressed  as 

s(t)  ■  Ap(t)cos[(Oct  +  0(t)  +  0]  (K.l. 2) 
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where  p(t)  is  a  unit  amplitude  rectangular  gating  function  of  duration  T,  coc  is  the 

carrier  angular  frequency,  0(t)  is  the  signal  phase  modulation  and  <(>  is  the 
unknown  initial  random  phase  which  is  uniformly  distributed.  We  now  define 
the  signal  energy  Ep  in  the  pulse  of  duration  T  as 


T 

Ep  *  j  s2(t)  dt 
0 

T 

=  A 2  f  cos2[coct  +  0(t)  +  <p]dt 
0 


(K.1.3a) 

(K.1.3b) 


A2  7 

■  -y-J  {1  +  cos[2o)ct  +  20(t)  +  2<|>1 }  dt.  (K.1.3c) 

0 

The  function  0(t)  is  slowly  varying  and  <J>  is  a  constant  for  a  specific  pulse 
train  so  that 


2  T 


A 

2 


A^T 


dt  + 


_A 

2 


f  cos[2(Oct  +  c]dt 
0 


(K.1.4a) 

(K.1.4b) 


where  the  constant  c  is  used  to  represent  2[0(t)  +  4>]  and  the  second  integration  is 
negligible  due  to  the  rapid  fluctuations  of  the  2coc  frequency  term.  Using 

eq(K.1.4b)  and  the  defmition  of  the  signal-to-noise  ratio  ftp 


u  A2T  P? 

RP*  N0  *  N0  “¥o 


(K.1.5) 


where  \|/0*No/T  is  the  matched  filter  output  noise  power  for  a  pulse  of  duration 
T.  For  a  filter  bandwidth  B-l/T,  we  have 


Vo  *  N(/T*  N0B. 


(K.1.6) 


296 


We  now  consider  an  equivalent  density  distribution  to  that  expressed  by 
eq(K.l.l)  in  order  to  determine  relationships  between  the  various  parameters 
defined  above.  Let  us  define  a  new  random  variable  Vj  such  that 


vi 

Vo* 


(K.1.7) 


and  consider  the  probability  density  p^vjlJLp)  as 


P^ilkp) 

P(vil&p)  -  iji 


ri=vi/¥, 


1/2 


(K.1.8) 


where  the  Jacobian  J  is 
dv; 

J  =  d^-vJ*. 


(K.1.9) 


Using  eqs(K.l.l),  (K.1.5)  and  (K.1.9)  in  (K.1.8),  we  have  the  new  density 
function  expressed  as 


p(vjl  A)  = 


~exp(-(vf+A2)/2\|/0]I0(viA/n/0)  vj£0 


(K.1.10) 


lo 


Vj<0. 


We  note  that  Jlp  ,  the  sampled  matched  filter  envelope  output,  is 
VjA/Vo.  in  the  new  notation.  In  [13],  it  is  shown  that  the  Bayesian  detection  test 

strategy  for  N  observations  of  the  non-fluctuating,  incoherent  pulse-train  reduces 
to  the  threshold  comparison  test  which  in  our  tranformed  notation  is  expressed  *s 
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it  \r>  *  Ti  (signal  present) 

exp(-NA2/2Vo)ni0(viA/VW)|<Ti1  (signai;bsem)  (K.1.11) 

where  Tj  is  the  threshold.  For  known  N  and  A/yJ^,  an  equivalent  test  strategy  is 


it  j/2 J  ^  Tjexp(NA2/2vj/0)  =  T2  (signal  present) 

A*  o(vi  Vo  )  <  t2  (signal  absent). 


(K.1.12) 


Since  Iq(x)  is  a  monotonically  increasing  function  of  x,  Influx)]  is  also 
monotonically  increasing  so  that  an  alternate  test  is 


xn  \  -  T3  (signal  present) 

S  lnIWviA/Vo  )]  |  <  t3  (signal  absent). 


(K.1.13) 


where  T3  =  In  T2.  The  leading  terms  in  the  power  series  expansion  of  I0(x)  are 


00  x2n 

I0(x)  =  X  -  =  1  +  x2/4  +  x4/64  +  .. 

n=0  22nn!n! 


(K.1.14) 


Therefore,  for  small  x 


lnl0(x)  *  x2/4 


x  «  1 


(K.1.15) 


For  a  small  signal-to-noise  ratio  such  that  xavjA/\jfJf2«l,  eq(K.1.13)  can  be 
expressed  as 


N  2  £  4T3y0/A2  =  T4  (signal  present) 

',Vi  <  T4  (signal  absent). 


(K.1.16) 


Thus,  for  small  x,  a  square  law  detector  provides  nearly  optimal  performance. 
For  x>l,  I0(x)  can  be  approximated  by  the  asymptotic  expansion  [89] 
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I<)(x)  = 


V2?tx 


x  >  1 


(K.  1.1 7a) 


lnlg(x)  =  x  -  2  ln2rcx  +  ln(l  +l/8x  +  ...) 


x  >  1. 


(K.  1.1 7b) 


For  a  large  signal-to-noise  ratio  such  that  x=svj »  1 ,  the  first  term  on  the 
RHS  of  eq(K.  1.17b)  is  the  dominant  term.  Therefore,  eq(K.1.13)  can  be  reduced 


N  £  T3y)/2/A  =  T<  (signal  present) 

V  Vi  (K.1.18) 

l-l  <  T5  (signal  absent) 

which  indicates  that  a  linear  envelope  detector  is  nearly  optimal  for  x  »1.  We 
now  return  to  the  test  statistic  expressed  by  eq(K.1.16)  for  the  small  signal  case 
and  define  the  test  statistic  by  [73,74] 


CT  l  <  t5 


(K.1.18) 


N  * 

y  =  2  v-. 

i=l 


(K.1.19) 


Defining  a  related  test  statistic  Y=  y/2\j/0  and  random  variable  Zj  such  that 


we  have 


Zf=  vi/2\j/0 


l  N  N 

Y  =  2  2  vi/Vo=  2zi- 
i=l  i=l 


(K.1.20) 


(K.1.21) 


In  the  discussion  which  follows,  we  consider  the  characteristic  function  of 
the  probability  density  distribution.  In  order  to  utilize  available  Fourier  integral 
pairs,  we  now  consider  another  transformation  of  eq(K.l.lO).  Using  the 
transformation  of  variables  defined  by  eq(K.1.20),  eq(K.l.lO)  can  be 
transformed  as 
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p(zil  A)  = ' 

[  pCvjIA) 

Ul 

l  0 

Zj  2  0 

Zj  <  0. 

(K.1.22) 

where  J  is  the  Jacobian.  In  this  case, 

Ul  = 

•fci  . 

-VVo 

0 

(K.1.23) 

so  that 

p(zil  A)  = ’ 

exp[Azi+A2P.\\tQ)]l0[^f2z~A/\yln]  zj  >  0 

k  0  zj  <  0. 

(K.1.24) 

The  random  variable  Y  is  the  sum  of  N  statistically  independent  random 
variables  Zj.  The  characteristic  function  of  the  random  variable  Y  is  expressed  in 

terms  of  the  characteristic  functions  of  the  individual  random  variables  CZ.(^IA) 


as 

N 

Cy(^IA)  =  n  Cz.(SlA).  (K.1.25) 

i=l  1 


where  the  characteristic  function  for  zj  is  expressed  as 


CZ.(^IA)  =  fexp(j^Zj)p(zjlA)  dz,.  (K.1.26) 

-oo 

Substituting  eq(K.1.24)  into  (K.1.26)  yields 


CjsjftlA)  =  Jexp(j4zi)exp[-(zi+A2/2\j/0)]Io(^f2l^\/\|/(}/2)dzi. 
Using  integral  pair  655.1  in  [75],  we  obtain 


(K.1.27) 
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_  .....  exp[j A2V2 V0<  1  -j^)] 

C^IA> - Hi - 


(K.1.28) 


Substituting  eq(K.1.28)  into  (K.1.25)  yields 
r  .....  NexpUA24/2Vo(l-j^)] 

cy(sia)  =  n  i.j^ 


exP0NA2$/2yo(l-j5)] 


(K.  1.29a) 


(K.  1.29b) 


As  noted  above,  the  signal  amplitude  A  for  the  model  !(INCOH)  target 
model  is  constant  on  each  pulse  train  but  varies  randomly  from  pulse-train  to 
pulse-train  with  Rayleigh  probability  density 


P(A)  =  1 


r  a 

A 


jexpr  vaJ] 


A£0 

A<0 
2 

where  the  mean  square  value  of  A  is  2Aq;  ie.. 


0 


A2  =  j  A2  p(A)dA 


o° 

=  -T  I  A3  exp[-A2/2Ag)dA 
Aorf 

l  ^ 

*  — 2  J  ocxp[- 

2A»  o 


a/2A  Jda 


-2A, 


(K.1.30) 


(K.  1.3  la) 
(K. 1.31b) 


(K. 1.31c) 


(K.1.31d) 


where  a=A2  and  eq(K.1.30)  was  used  to  obtain  (K.  1.3 lb).  The  single  pulse 
power  signal-to-noise  ratio,  commonly  used  in  the  radar  literature,  is  expressed 
as  [72,74] 
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(K.1.32) 


so  that  averaging  with  respect  to  A  yields  using  eq(K.1.31d) 


(S/N)avg  -  2y0 


a2/ 

=  VVo55  2 


(K.  1.33a) 


(K.  1.33b) 


Averaging  eq(K.  1.29b)  with  respect  to  A  using  (K.1.30),  we  obtain 


CY($)  =  Cy(4IA)a  =  |  CY(^IA)p(A)dA 

0 

^exp['AVldA 


where 


2  1  ,_JNL_ 

*  2Aj  2Vo(l-j^)  • 


Evaluation  of  eq(K.  1.34b)  yields 


(K.  1.34a) 


(K.  1.34b) 


(K.1.35) 


CV®  _2g2Ao(l-j4)N  ' 

Using  cq(K.1.35)  in  (K.1.36),  we  have 


(K.1.36) 


Cy(4)  = 


_ _ 1 _ 

a?  -i-  . — —  /i  :t\N 

”°  Aq  Vo(>-jOa'J§) 


(K.  1.37a) 
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_ l _ 


(1  -j$-jSNAo/Yo>0  -j?) 


:exN-l 


{ 1  -  j^(l  +  N(S/N).V.]}(1  -  j!;) 


.cnN-I 


(K.  1.37b) 


(K.  1.37c) 


(K.1.37d) 


where  eq(K.  1.33b)  was  used  to  obtain  eq(K.1.37d).  From  eq(K.1.37d),  we  can 
obtain 


[1  -  j$(l  +  N(S/N)avg)]  CY(§)  =  ~ fry  . 


(K.1.38) 


Rearranging  the  terms  of  eq(K.1.38)  yields 


cYffl  =  (H^71  +  j^[1  +  N(S/NW  Cy© 


(K.1.39) 


Taking  the  anticharacteristic  function  of  eq(K.1.39)  term  by  term  yields 
P(Y)  =  ~ (Ne2)|:Y)  *  0  +  N(S/N)avg)  ^  . 


(K.1.40) 


In  the  absence  of  a  signal,  (S/N)av2=0  so  that  eq(K.1.40)  yields 


dEffl  .  n/y\  .  YN'2  exp( 
dY  +  P(Y)  "  (N-2)! 


(K.1.41) 


The  solution  of  eq(K.1.41)  is 


d(Y)  =  -2 - 

(N-l)! 


(K.1.42) 
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Denoting  the  threshold  as  Yb,  the  false  alarm  probability  is  obtained  as 


Pf.  =  J  P(YIHq)  dY 

(K.  1.43a) 

”  Yb 

=  1  -  J  p(Y)  dY 

(K.  1.43b) 

0 

V»  exjjJQ 

-  1  '  0J  (N-l)! 

(K.  1.43c) 

=  (N-l) 

(K.  1.43d) 

The  integral  in  eq(K.  1.43c)  is  the  incomplete  gamma  function,  IpCYb/VN.N-l). 
where 

uVT+S  /  \  s 

(K-144) 

and  results  have  been  tabulated  in  [76].  Eq(K.1.40)  can  be  used  to  obtain  the 
probability  of  detection  using 

oo 

Pd=  Jp(Y)  dY  (K.  1.45a) 

M) 

Yb 

.1-  Jp(Y)dY  (K.  1.45b) 

0 
Y 

=  1-  J  'N  (N.X2P)t'Y)  dY  +  <1  +  N(S/N),v,)  [p(Y)]lob.  (K.  1.45c) 

The  integral  in  eq(K.  1.45c)  is  the  incomplete  gamma  function,  IrCYb/VfTi.N^). 
An  alternative  expression  for  p(Y)  similar  to  that  derived  in  [13]  is 


'}  +  NCS7FIw]N'2  exp[-Y/(l+NCs/N>avf!))  r  y  ' 

P(Y)“  N(S/N)a>.  [r  [%fNM(l+l/N(S/N),v.)  •(N'2,J 


(K.1.46) 


Using  eq(K.1.46)  in  (K.  1.45c),  we  obtain 


Pa  =  1  -  Ir 


■  (N‘2)]  +  ['  +  NisfeJ Vw  +  N(S/NW] 


*  *r  VNT[l+l/N(S/N)avg]  •  (N'2) 


(K.1.47) 


K.2.  Model  II(INCOH)  Signal  in  White  Noise 

We  now  develop  the  probability  of  detection  expression  for  the  model 
II(INCOH)  signal  in  additive  Gaussian  white  noise  problem.  In  [13],  it  is  noted 
that  the  receiver  structure  for  this  case  is  the  same  as  that  for  the  nonfluctuating 
pulse-train.  Therefore,  the  probability  of  false  alarm  is  the  same  as  that 
expressed  by  eq(K.  1.43d).  The  probability  of  detection  will  be  evaluated  using 
eq(K.  1.45b).  In  this  case,  however,  each  pulse  amplitude  in  a  given  pulse-train  is 
a  random  variable  with  a  Rayleigh  density  distribution  expressed  by  eq(K.1.30). 
We  therefore  consider  the  density  function  p(Y)  where  Y  is  defined  in  eq(K.1.21) 
and  express  it  as 

P(Y)  =  P(YIA)a  (K.2.1) 


where  the  averaging  is  over  A  and  A  represents  the  set  of  statistically  independent 
random  amplitudes  (Ai,A2,...,An)  in  each  pulse  train  and  each  pulse  .  The 

-  N 

characteristic  function  Cy(5)&  of  the  sum  random  variable  Y=  is  related  to 

that  of  the  random  variable  zv  i=l,2,...,N  by 

(K.2.2) 

i=l 
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Since  Cj.©^  is  same  for  all  i, 

c5®a-[(Ci,©ai]n- 


(K.2.3) 


Using  eq(K.i.37d)  with  N=1  and  using  the  subscript  Aj  to  denote  that  the  average 
is  over  the  ith  pulse  amplitude,  we  obtain 


,j§[i  +(S/N),V.] 


(K.2.4) 


Substituting  eq(K.2.4)  into  (K.2.3) 


Cy(4)a  { 1  *  j^t  1  +  (S/N)avg] } N 

_ 1 _ 

“  [1  +  (S/N)avg]N{  1/[1+(S/N)avg]  -j£}N 


(K.2.5a) 


(K.2.5b) 


Using  Fourier  transform  pair  431  in  [75],  the  anticharacteristic  function  of 
eq(K.2.5b)  is  found  to  be 

P(Y)  *  [IT  (S/N)1  ]N(N-1)!  YN-1  exPt'Y/(l+(S/N)avg)].  (K.2.6) 


Using  eq(K.2.6)  in  (K.  1.45b)  provides 


Pd  =  1  -  JYb  P(Y)  dY 


(K.2.7a) 


“  1  '  (N-l)!  J0Yb  (l+(S/N)lvg)T  exPl "Y/(  1 +(S/N)lvg)]  1+(s/N),vg  (K'2'7b) 


Using 


1  +  (S/N). 


(K.2.8) 
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eq(K.2.7b)  becomes 


Ph  =  1- 


[‘Yb/(1+(S/N)avg) 


(x^expC-x)  /  (N-l)!]dx 


0 


=  1  -  Ir 


D 

yw+(s/N)avij  •  (N'!) 


(K.2.9a) 


(K.2.9b) 


KJ  Model  I(COH)  Signal  in  Noise  using  Coherent  Pulse  Train 
Detection 

In  this  section,  we  consider  the  case  of  a  coherent  pulse  train  that  is  exactly 
known  except  for  initial  phase;  ie.,  the  phase  relations  between  pulses  in  the  train 
are  assumed  to  be  known  exactly,  but  the  initial  phase  on  each  train  is  unknown. 
This  condition  is  met  for  the  model  I(COH)  signal.  We  also  note  in  the  process 
synthesis  procedure  described  in  chapter  4,  it  is  this  case  which  is  approched  as 
the  temporal  correlation  is  increased. 

The  detection  curve  for  this  case  can  be  obtained  as  follows.  We  first  note 

that  the  signal-to-noise  ratio  defined  above  is  that  for  single-pulse  detection.  Let 
us  define  this  ratio  for  channel  j  (see  next  section)  as  (S/N)j  ^  The  effective 

signal-to-noise  ratio  for  an  ideal  coherent  multiple  pulse  system  on  channel  j 
using  Nt  pulses  is  [88,89] 


(S/N)jtNT  ~  Nt  (S/N)jfl  (K.3.1 ) 

where  NT  is  the  number  of  pulses  coherently  integrated.  Thus,  the  model  I(COH) 

detection  curve  can  be  plotted  by  first  determining  the  single-pulse  detection 
probability  for  (S/N)j  j  and  then  using  the  detection  probabilities  corresponding 

to  (S/N)j  These  analytic  curves  are  used  in  chapter  7  to  compare  to  the 

results  obtained  using  the  coherent  pulse  train  detection  implementation  described 
in  chapter  6.0. 

K.4  Multichannel  Post-Detection  Integration 
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The  case  of  multichannel  post-detection  integration  has  been  considered  in 
the  context  of  frequency  diverse  channels  [78]  for  the  model  I(INCOH)  signal  on 
each  channel  and  no  correlation  between  channels.  This  is  a  special  case  in  this 
dissertation  with  total  temporal  correlation  on  each  channel  i  and  no  cross¬ 
channel  correlation  between  all  i,j«l,2,...,J.  In  this  section,  we  review  this 
detection  problem.  In  addition,  we  also  consider  the  problems  for  the  case 
n(INCOH)  model  with  no  channel  correlation,  as  well  as  the  model  I(INCOH) 
signal  with  total  correlation  between  channels.  These  last  two  models  provide  the 
extremes  in  detection  performance  for  multichannel  post-detection  integration 
and  will  be  used  to  bound  the  detection  results  presented  in  section  7.6. 

K.4.1.  Correlated  Signal,  Uncorrelated  Channels 

In  this  subsection,  we  briefly  outline  the  approach  presented  in  [78].  In 
that  paper,  an  exact  closed-form  solution  is  derived  for  the  output  probability 
density  function  and  the  detection  probability  for  a  given  false  alarm  probability 
and  signal-to-noise  ratio  when  all  JN  pulses  are  square  law  detected  and 
incoherently  integrated.  Each  of  the  JN  pulses  has  independent  Gaussian  noise, 
and  each  pulse  train  of  N  pulses  has  an  independent  Gaussian  signal,  giving  a  total 
of  J  independent  signals  in  all  JN  pulses.  In  [78],  Vannicola  considers 
representing  eq(K.1.2l)  in  our  notation  as 

,  JN  -  JN 

Y-I  zj. 

where  the  probability  density  of  Y  under  hypothesis  Hq  is 
vJN-1  *-Y 

P(Y;H 0)«  (JR'.'ifr  (K*4*2) 

so  that  the  false  alarm  probability  becomes 
7  7YJN'i  e*Y 

P„.  JP(Y;  H0)dY  -  J  -(-JN.))!  dY.  (K.4.3) 


(K.4.1) 
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This  integral  has  been  evaluated  in  [77]  for  1£  JNS150  and  false-alarm 
probabilities  equal  to  10'm,  where  m  is  an  integer  ranging  between  1  and  12. 

In  [78],  the  probability  of  detection  is  derived  starting  with  the 
characteristic  function  of  the  signal  out  of  the  N  pulse  integrator  for  a  single 
channel  using  an  alternate  form  of  eq(K.1.37d).  In  our  notation,  this  equation  is 
expressed  as 


HI 


N 


Cy,®  V(1+  N(S/N),vg)  (-1/(1+(S/N),V|)  +  j$]  (-l+j5)N'>  •  (KA4) 


Adding  the  integrator  outputs  for  the  J  channels,  we  have 


-S 


(K.4.5) 


where  Yj  is  independent  of  Y^,  i  *  k.  The  characteristic  function  of  Y  is 


HI 


JN 


Cy(5)A|,Ai . A>  “  (1 +N(S/N)1>|]J  ( - 1/[  1  +($/N)t>|]+j)‘ )  J(- 1  +J5)J(N- 1 ) '  <K'4'6) 


Fourier  transforming  eq(K.4.6),  Vannicola  [78]  obtains 


(*6)J  e^Y 

p(Y)-&= 


(J-l)l  1}  (JN.M)KM-j)l 

)Nf 1  (JN-2-k)l  [(H-flYI* 

tfb  (JN-M-k)!(J-l)l  (k)l 


(K.4.7) 


where  P«*1/[1+N(S/N)#V|].  Using  eq(K.4.7)  in  eq(K.  1.45b), 
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Pd 


(By;1  [  J  (JN-2-iH  Ir((l-*-j).-gYb) 

1  ‘  (l+pyN-1 1  (JN-J-l)!(J-l-j)!  j! 

+  e,Nf;,+a)k  — (JN-2-k)!  .  MQ+W 
P  P'  (JN-J-l-k)l(J-l)!  k! 


(K.4.8) 


where  Ir(»)  is  the  incomplete  gamma  function.  Probability  of  detection  curves 

aie  shown  in  [78].  We  note  that  these  results  describe  the  special  case  in  this 
dissertation  for  incoherent  integration  of  a  multichannel  Gaussian  signal  with 

Xjjul  and  lpjjl-0  in  additive  Gaussian  white  noise;  ie.,  the  signals  are 

casel(INCOH)  on  each  channel  and  are  uncorrelated  across  channels.  Finally,  as 
noted  in  [78],  computational  difficulties  were  noted  in  the  evaluation  of 
eq(K.4.8).  In  Appendix  L,  an  alternative  derivation  is  suggested  which  may 
overcome  these  limitations. 


K.4.2.  Uncorrelated  Signal,  Uncorrelated  Channels 

For  the  case  where  the  pulses  on  each  channel  are  described  by  model 
II(INCOH),  we  consider  the  form  of  eq(K.2.5b)  for  each  of  the  j  channels,  so  that 


CyJ®aj  •  (1  +  (S/n)IV8]N(i/[i+(s/n)1V|]  -j$)N ' 
Adding  the  integrator  outputs  for  the  J  channels,  we  have, 


(K.4.9) 


(K.4.10) 


where  Yj  is  independent  of  Y^,  j*k.  The  characteristic  equation  of  Y  is 


CY(^Aj  ’  [l  +  (S/N)lv|yN{  1/[1+(S/N)„,]  -j5 ) ,N  (KAU) 

where  Aj  contains  the  JN  amplitudes.  Again,  using  Fourier  pair  431  in  [75],  the 
anticharacteristic  function  of  eq(K.4.11)  is 
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(K.4.12) 


P(Y)  =  [1  +  (S/N)avg]JN(JN-l)!  YW  1  exP l -Y/[  1+(S/N)avg] } . 

Using  cq(K.4.12)  in  (K.4.44b)  provides 
P<1  -  1  -  fYb  p(Y)  dY  (K.4.13a) 

=  1  -  (jFTTjF  }0Yb  (M^f'lexP[-Y/<1+(S/NW)  ^2  •  (K.4.13b) 

Using  x  =  Y/[1+(S/N)avg],  eq(K.4.13b)  becomes 


Yi41-KS/N)avg) 

Pd*  1-  J  (xJN-1exp(-x)  /  (JN-1)!]  dx 
0 


Yb 

VIN[1+(S/N)avg] 


(JN-1) 


(K.4.14a) 


(K.4.14b) 


A  comparison  of  eqs(K.4.14b)  and  (K.2.9b)  indicates  that  in  the  special 
case  where  the  pulses  are  uncorrelated  on  each  channel  as  well  as  across  each 
channel,  the  detection  curves  for  the  single  channel  model  II(INCOH)  can  be  used 
for  the  corresponding  multichannel  case  with  N  replaced  by  JN.  This  result  will 
be  used  in  section  7.6.4  to  provide  a  performance  curve  for  a  detection  problem 
with  J«2,  N=10  by  using  an  available  single  channel  model  II(INCOK)  detection 
curve  for  20  pulses. 


K.4.3.  Correlated  Signals,  Correlated  Channels 

For  the  case  where  the  JN  pulses  on  all  the  channels  are  described  by  the 
model  I(INCOH)  signal,  we  can  reconsider  the  non-fluctuating  pulse  train  of 
section  K.l  to  contain  JN  signals  with  constant  amplitude  and  random  phases  on 
each  realization.  In  this  case,  eq(K.1.21)  again  becomes 
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(K.4.15) 


,  JN  ,  JN 

Y  =  2Xvi/Vo=X  zi* 

i=l  i=l 

Following  the  same  discussion  as  presented  in  that  section,  but  using  JN  to 
replace  N,  eq(K.1.47)  is  modified  as 


Ph  =  1  -  Ir 


^=,(JN-2)  +[l  +  JNtS/Nj'^rt-Vd  +  JN(S/N).,,)] 


*  VJi4T(l+l/JN(S/N),v|)  ■  (,N'2) 


-l}  (K.4.16) 


Similar  to  the  previous  case,  eq(K.4.16)  reveals  that  the  detection  curves 
for  the  single  channel  model  I(INCOH)  can  be  used  for  the  corresponding 
multichannel  case  with  N  replaced  by  JN.  Thus,  as  noted  previously,  available 
detect^n  curves  can  be  used  for  this  limiting  case. 
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APPENDIX  L  ALTERNATIVE  DERIVATION  FOR 
MULTICHANNEL  Pd  ANALYTIC  EXPRESSIONS 


In  [78],  Vannicola  derives  the  derivation  of  the  probability  of  detection 
using  eq(K.4.4).  In  this  appendix,  we  consider  the  alternative  expression  of 
eq(K.1.37d)  for  the  ith  channel;  ie.. 


Cy>®  =  Cy.^IAi)  Ai "  { 1  -  j«l  +  N(S/N),vg] } (1  -  j4)N-'  • 
Adding  the  integrator  outputs  for  the  J  channels,  we  have 

Y.-SYi 

i=l 


(L.l) 


(L.2) 


where  Yj  is  independent  of  Y^,  i*k.  The  characteristic  function  of  Y  is 
Cy©  =  Fj  Cy.(5) 

_ 1 _ 

{1  -j§[l  +N(S/N)avs]}J(l  -j5)J<N-»- 

This  equation  enables  us  to  obtain 

{1  -m  •*-N(S/N),>8)}J  Cy©a  =(1  .^(N-l)-  0-4) 

Let  a  =  [1+  N(S/N)avg]  and  consider 

[1  -  fea]J  =  £  [k]  (-j4a)J'k  (L.5a) 

k=0  LJ 

=  1+  S  [k]  (*j^a)J'k-  (L.5b) 

k=0 

where 


(L.3a) 

(L.3b) 
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Using  eq(L.5b)  in  (L.4)  and  rearranging  terms 


Cy©*  * 


1 


'  CY^A 

•  £[k](“)J'k(-^)J'fc  cy©a 


(L.7a) 

(L.7b) 


The  anticharacteristic  function  of  eq(L.7b)  taken  term  by  term  is 

YJ(N-l)-ie-Y  J-l  y 


p(Y)  = 


[J(N-1)-1]! 


dYJ-k 


(L.8) 


where 


(.-&*  cy(4)a 


dl  kP(Y) 
dYJ*k  • 


(L.9) 


Eq(L.8)  is  a  non-homogeneous,  linear  differential  equation  with  constant 

coefficients  that  depend  upon  a,  J  and  k.  The  solution  of  this  equation  is  to  be 
used  in  eqs(L.7a)  to  obtain  P^. 
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APPENDIX  M  CONSIDERATION  OF  THE  ERROR  VECTORS 

£p(n)  AND  £p(n) 

In  this  appendix,  we  First  consider  the  error  vectors  £(n)  and  £(n)  discussed 
in  chapter  6.0  and  show  the  conditions  under  which  they  are  equivalent.  Second, 
we  generalize  the  presentation  of  the  normal  equations  derived  in  Appendix  A  to 
the  case  of  processes  with  unconstrained  quadrature  components.  Finally,  we  also 
derive  the  form  of  the  augmented  normal  equations  for  the  unconstrained 
quadrature  component  case. 

M.l  CONDITIONS  FOR  THE  EQUIVALENCE  OF  £p(n)  AND  £p(n) 

The  2Jxl  real  forward  error  vector  ep(n)  resulting  from  a  filter  of  order  p 
is  expressed  as 


£p(n)  =  i(n)  -  £p(nln-l,...,n-p) 

(M.1.1) 

where 

f  fipi(n)  1 

£p(n)  =  M 

(M.1.2a) 

and 

r  »i(n)  1 

1<n)  ■  [jQftO.  ' 

(M.l. 2b) 

On  the  other  hand,  the  complex  Jxl  error  vector  £p(n)  is  expressed  as 

£p(n)  =  *(n)  -  &p(nln-l,...,n-p)  (M.l. 3) 

where 

&p(nln-l . n-p)  =  -  £  Ap(k)  *(n  -  k).  (M.1.4a) 

kal 

and 
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i(n)  =  ij(n)  +  j  *Q(n). 


(M.1.4b) 


In  Appendix  N,  we  consider  the  probability  density  functions  for  both  the 
conventional  complex  Gaussian  random  vector  and  the  general  Gaussian  vector 
with  unconstrained  quadrature  components.  We  showed  that  the  latter  is  a  more 
general  density  distribution  which  is  equal  to  the  former  under  the  special 
conditions  that 


Rx^O)  «  R^fl)  all  j,  k=l,2,...J 

and 

IQ  QI 

Rx^l)  =  -  Rxjk(»  all  j,  k=l,2 . J. 

Specifically,  when  eqs(M.1.5)  hold, 


(M.1.5a) 


(M.1.5b) 


(M.1.6) 


where  the  quantities  ^'^and  j^'  denote  the  values  assumed  by  the  complex  and 
real  random  vectors,  Xj  and  r }  N(see  Appendix  N).  In  this  special  case, 
therefore,  the  processes  *  and^^  are  identical.  And  so,  the  vectors  i(n)  and 

&(n)  denoted  in  eqs(M.l)  and  (M.1.3),  respectively,  and  their  associated  linear 
estimates  tp(nln-l,...,n-p)  and  i^(nln-l,...,n-p)  are  identical.  As  a  result,  the 
error  vectors  £p(n)  and  £p(n)  are  also  identical;  ie., 

£p(n)  =  £p(n)  when  Rxjk(D  =  R^(D  and  R^k(l)  =  -  Rx'k(D 

all  j,  k=l,2,...,J.  (M.1.7) 
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M.2  THE  PREDICTION  ERROR  FILTER  NORMAL  EQUATIONS 
FOR  PROCESSES  WITH  UNCONSTRAINED  QUADRATURE 
COMPONENTS 


From  eqs(6.3.10),  we  have 


fip(n)  =  i(n)  -  f(nln-l,...,n-p) 

(M.2.  la) 

*  l(n)  +  £  **  J(k)l(n  -  k) 

k=l 

(M.2.  lb) 

=  l(n)  +  (A)l  tn-l.n-p 

(M.2.1c) 

where  tp(nln-l,...,n-p)  is  obtained  using  a  linear  combination  of  p  past  data 
samples,  and  is  defined  as 

fD(nln-l,  ...,n-p)  =  -  £  **p(k) 
F  k=l 

tl 

I _ J 

(M.2.2) 

£n-i,n-p  =  [lT(n-l)  tT(n-2) ...  iT(n-p)]. 

(M.2.3) 

T 

The  vector  of  matrices  (*D p  is  defined  without  the  identity  matrix  I,  so  that 

(4)p  =  [Ap(l)  Ap(2) ...  Ap(p)] 

(M.2.4) 

T 

where  the  2Jx2J  block  matrix  <Ap(k)  is  expressed  in  terms  of  its  JxJ  block 
elements  such  that 


T  T 

Apn(k)  Ap2j(k) 

T  T 

Ap22(k) 


(M.2.5) 
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and  the  numerical  subscripts  on  the  JxJ  block  matrix  elements  of  eq(M.2.5) 
designate  their  position  in  the  matrix.  In  expanded  form,  eq(M.2.1)  can  be 
written  as 


£pl(n) 

'  ii(n) ' 

,&pQ(n) 

.XQ(n). 

+ 


Apn(k)  ApjjOk) 

T  T 

ApjjOO  Ap^Qc) 


‘  ii(n-k) ' 

XQ(n-k) 

(M.2.6) 


Let 

E[l(n)in-i,n-p]  SC  (M.2.7) 

and 

E[l  n-l,n*p£n-l,n-pl  =  [Rn-lp  s  Q*  (M.2.8) 

With  respect  to  dimensions,  (a£Jp  is  2Jx2Jp,  n_p  is  2Jpxl,  C  is  2Jx2Jp 

and  Q  is  2Jpx2Jp.  We  note  that  QT  »  Q  and  RTQ]£>0  for  any  2Jpxl  vector 
when  Q  is  positive  definite.  Now,  the  2Jx2J  error  covariance  matrix  is  expressed 
as 

E[£p(n)tJ(n)]  -  E(  (i(n)  +  (A)p  tn-i,n-pHlT(n)  +  lJ.i,n.p(«i)p] )  (M.2.9a) 

=  E[i(n)iT(n))  +  <A)pCT  +  C(A)P  +  (ai)J  Q(A)P  (M.2.9b) 

=  R„(0)  -  CQ-'CT  +  [(A)J  +  CQ  l]Ql(ai)p  +  CQ1]7.  (M.2.9c) 


T  1 

Let  the  2Jx2Jp  matrix  [(^L)p  +  CQ'  ]  be  expressed  as 
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[(«3Jp  +  CQ'1] 


(M.2.10) 


where  is  a  2Jpxl  vector.  We  now  denote  the  last  term  in  eq(M.2.9c)  as  the 
2Jx2J  matrix 


L  =  [Gd)J  +  CQ1]  Q[Gi)p  +  CQ-']t  =  [tmj] 


[Hi  V. 2  ...  U.,) 


•  •  • 


1  £  m  j  <:  J 


(M.2.11a) 


(M.2.11b) 


where  the  real  scalar  tmj  is  now  expressed  as 

lmj  =  (M.2.12) 

The  real  quantity  Cjj  =  ILjQILj  >  0  for  any  ^  *  Q.  ,  since  Q  is  Hermitian  and 

provided  Q  is  positive  definite;  the  minimum  value  of  Cjj  is  zero  and  is  attained  if 
and  only  if  Hj=(2  Therefore,  trL  is  minimized,  attaining  value  zero,  by  the 
choice  ,  l£j£J.  Using  eq(M.2.9c),  trE[£p(n)£p(n)]  =  E[£p(n)£p(n)]  is 

minimized  by  the  choice  of  (4)p  as 
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T.  *  *  — 

■»;  . 


1-'  “ST  "  •  r  - 


'•  *»■*  all 


A!- ■»»  ■■.  -■*■**■* 


-l 


or 


Od)I  =  -CO 


<*1)Iq=-C 


(M.2.13a) 


(M.2.13b) 


T 

since  the  leading  two  terms  in  eq(M.2.9)  are  independent  of  (A)p.  Eq(M.2.13b) 
can  be  written  in  expanded  form  using  eqs(M.2.4),  (M.2.7)  and  (M.2.8),  so  that 


~  T  T 

Apn(k)  Ap21(k) 

Rxx(m-k)  R^(m-k)  ‘ 

Rxx(m)  R?x(m) 

T  T 

APl2(k)  Ap22(k) 

R?x(m-k)  R«(m-k) 

R£(m)  R$?(m) 

(M.2.14a) 


m  *  l,2,...,p 


or 


A  p(k)  Rn.(m-k)=  -  R^m) 


m  =  l,2,...,p.  (M.2.14b) 


i 

i 


Eq(M.2.14)  contains  the  normal  equations  for  a  prediction  error  filter  of  order  p 
using  Gaussian  processes  with  unconstrained  quadrature  components. 

M.3  PRINCIPLE  OF  ORTHOGONALITY  FOR  GAUSSIAN 
PROCESSES  WITH  UNCONSTRAINED  QUADRATURE 
COMPONENTS 

We  now  show  that  the  error  vector  fi.p(n)  is  uncorrelated  with  past 
observation  vectors  when  eqs(M.2.14)  hold.  Eq  (M.2.14)  can  be  expressed  as 

£  «4.p(k))E[i(n  -  k)iT(n  -  m)]  *  -  E[i(n)£T(n  -  m)]  m  =  l,2,...,p.  (M.3.1) 

k*l 
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Rearranging  eq(M.3.1)  and  interchanging  the  order  of  expectation  and 
summation,  we  can  obtain 


E 


t(n)  +  J^**.p(k)i(n  -  k)|iT(n  -  m)  ■  [0]  m  ■  1,2,..., p. 


(M.3.2) 


From  eq(M.2.1b),  it  follows  that 

E[fip(n)iT(n  •  m)]  ■  [0]  m  »  l,2,...,p. 


In  expanded  form,  eq(M.3.3)  becomes 


E[fi,(n)sj(n-I))  E(C|(n)sJ(n-l)] 

"  (0]  (0)  ' 

E[e«(n)iVl)]  E[c<j(n)gJ(n-l)] 

■ 

.  [0]  [0)  . 

(M.3.3) 


(M.3.4) 


Eqs(M.3.3)  and  (M.3.4)  denote  the  orthogonality  principle  for  the 
concatenated  quadrature  components.  It  indicates  that  when  the  error  vector  of 
eq(M.2.1)  is  a  minimum  mean-squared  error(MMSE)  vector,  the  quadrature 
components  of  the  error  vector  are  uncorrelated  with  those  of  the  past 
observation  processes. 

Following  a  similar  discussion  as  presented  in  Appendix  A  leading  to 
eq(A.35),  we  can  obtain 


E(cp(n)eJ(n)] 


{Rn(0)]^[RWI(0)],4[R2I(0))(4[Rwv(0)Jl 

[0) 


k-n 

k#n, 


(M.3.3) 


where  the  superscript  q  denotes  the  quadrature  form  of  the  correlation  matrices. 
Eq(M.3.5)  indicates  that  the  current  MMSE  quadrature  components  are  white 
noise  vector  processes.  We  also  note  that  this  condition  holds  when  the 
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coefficients  of  the  estimator  satisfy  the  concatenated  quadrature  form  of  the 
normal  equations. 

M.4  THE  AUGMENTED  PREDICTION  ERROR  FILTER  NORMAL 
EQUATIONS  FOR  PROCESSES  WITH  UNCONSTRAINED 
QUADRATURE  COMPONENTS 


Following  a  presentation  similar  to  that  in  section  2.4.1,  we  first  consider 
eq(M.2.1c)  written  in  matrix  form  as 


T 

fip(n)  ■  jtn,n*p 

(M.4.1) 

where 

(4p)TJ 

(M.4, 2a) 

tn,n-p  ■  llT(n)  tT(n-l )...£T(n-p)l 

(M.4.2b) 

IT(k)  -  [r,(k)  r,(k).,.r,(k)). 

(M.4.2c) 

Poswnultiply  both  sides  of  eq(M.4,l)  by  jn.n-p  and  take  the  expectation  operation 
so  that 


T  T  T 

Elfip(n)  J^n.n-p)  m  E(  6p  In.n-pln.n-p) 

(M.4, 3*) 

T  T 

■  ^p^lln.n-pln.n-p] 

(M.4, 3b) 

(M.4, 3c) 

where  the  subscript  p+l  denotes  the  dimension  of  the  correlation  matrix  in  terms 
of  the  JxS  blocks  and  (ftglp+i  is  defined  as 
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"  ^lln,n*pln,ivp]* 


(M.4.4) 


Again,  -  denotes  time  order  reversal  of  the  vector  /in.pift.  Using  eq(M.4.2),  we 
now  expand  the  LHS  of  eq(M,4.3a)  as 

* 

EIfip(n)Xn,„-p)  -  E{fip(n)  ^(n)  ffn-l) ...  £T(n.p)] }  (M.4.3») 

-  {  E[gp(n)iT(n)]  E[fip(n)iT(n-l)] ...  E[gp(n)iT(n-p)]  }  (M.4.5b) 

and  determine  the  coefficients  of  «£p  subject  to  the  condition  that  gp(n)  is  a 

minimum  mean-squared  error  process.  Under  this  condition,  the  orthogonality 
principle  holds  (see  Section  M3);  ic., 

E[fip(n)iT(n-k)]  -  [0]  1 S  k  i  p  (M.4.6) 

so  that  cq(M.4,5b)  becomes 

ElSp(n)  ll,n.p)  -  {  E[ep(n)iT(n)]  (0)  [0] ...  |0]  }  (M.4.7) 


where  [0]  is  a  2Jx2 J  null  matrix.  Solving  eq(M.2.1b)  for  i(n).  we  obtain 


I(n)»  fip(n)  •  jc(n-k) 

k«l 


so  that 

E[tp(n)iT(n)]  .  E(sp(n)flJ(n)]  ■  £  E[cp(n)tT(n-k)]4p(k). 


(M.4.8i) 


(M.4,8b) 


Again,  using  eq(M.4.6),  the  summation  term  in  cq(M.4,8b)  is  a  null  matrix. 
Substituting  the  remaining  term  into  eq(M.4.7)  yields 
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(M.4.9a) 


Etfip(n)  -  {  E[fi|,(n)Sp(n)]  (01  (01 ...  (0)  } 

■  {  ffflp,  (0)  (0) ...  [0] }  (M.4.9b) 

where 

(E,lPr  ■  E[sp(n)eJ(n)]  -  (If]pr  (M.4.10) 

is  the  2Jx2J  forward  prediction  error  covariance  matrix  for  the  pth  order  filter 
expressed  in  concatenated  quadrature  form.  Since  eqs(M.4.3c)  and  (M.4.19b)  are 
identical  expressions,  equality  of  the  RHS  of  these  equations  provides 

■ip  [Kn1p+1  •  {  (Eflp,  [0]  [01 ...  (0) } .  (M.4.11) 

Taking  the  transpose  of  eq(M.4.11)  and  noting  that  [ftg]  is  equal  to  its  transpose, 
we  obtain 


[ftal^.^Lp  -  (rf]Pr  I  (M.4.12) 

where 

I- {I  (01(0)  ...(0)}  (M.4.13) 

and  I  is  a  2Jx2J  identity  matrix.  Eq(M.4.12)  is  the  augmented  form  of  the 

normal  equations  for  a  forward  multichannel  prediction  error  filter  with 
Gaussian  unconstrained  quadrature  components.  Thus,  contains  the  minimum 

mean-squared  error  (MMSE)  matrix  coefficients  for  a  linear  prediction  error 
filter  of  order  p. 
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APPENDIX  N  RELATIONSHIP  BETWEEN  THE  DENSITY 
FUNCTIONS  OF  THE  COMPLEX  GAUSSIAN  PROCESS  AND  THE 
GENERAL  GAUSSIAN  PROCESS  WITH  UNCONSTRAINED 
QUADRATURE  COMPONENTS 

In  this  appendix,  we  follow  a  presentation  developed  by  Weiner  [165] 
which  considers  the  probability  density  functions  for  both  the  conventional 
complex  Gaussian  random  vector  and  the  general  Gaussian  vector  with 
unconstrained  quadrature  components.  We  will  show  that  the  latter  is  a  more 
general  density  distribution  which  is  equal  to  the  former  under  special  conditions. 
A  discussion  of  this  subject  area  has  also  been  addressed  by  Goodman  [166].  In 
the  discussion  presented  here,  we  will  generalize  that  of  [165]  to  the  multichannel 
case. 

The  general  case  of  JN  complex  random  variables  is  now  considered  where 
J  and  N  denote  the  number  of  channels  and  time  samples,  respectively.  Using  the 
definitions  from  section  6.3,  let  us  consider  a  complex  baseband  process  x^n)  for 

channel  i  such  that 


x^n)  =  x^n)  +  j  XjQ(n)  i  =  1,2,...J  n  =  1,2, ...,  N  (N.l) 

where  Xjj(n)  and  XjQ(n)  are  the  in-phase  and  quadrature  components  of  the 
process  Xj(n),  respectively.  We  now  define  the  vectors 


S]|  N  =  if(2) ...  &[(N)] 

s5ltN=u$(i)s£(2)  ...$m 


where 


*f(k)  =  [xH(k)  x2I(k) ...  xj!(k)] 
2qOO  =  [x1Q(k)  x2Q(k) ...  xJQ(k)] 


(N.2a) 

(N.2b) 

k  =  1,2 . N  (N.3a) 

k  =  1,2,...,  N  (N.3b) 
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with  initial  conditions 


(N.4a) 

(N.4b) 


Slu 

^Qu=iQ(1)' 


Eqs(N.2)  and  (N.3)  enable  us  to  write  the  complex  vectors  *(n)  and  denoted 


by 

i(n)  =  ii(n)  +  j  Xq(n) 

n  =  1,2,...,N 

(N.5a) 

and 

&ijh  *h,N  +  ^  *Qi,n 

(N.5b) 

We  now  introduce  the  means  of  the  above  quantities,  such  that 

Xj(n)  =  E[Xi(n)] 

n  =  1,2,...,  N 

(N.6a) 

i[(k)  =  EUj(k)] 

k  =  1,2,...,  N 

(N.6b) 

iq(k)  =  E[xT(k)] 

k  =  1,2,...,  N 

(N.6c) 

^IlJM  =  EkT|,N  ^ 

(N.6d) 

5q,.n  =  E[*Qi.n] 

(N.6e) 

and 

&i,n  =  EbiJ. 

(N.6f) 

By  definition,  the  JNxJN 

covariance  matrix  of  the  complex 

vector  x  is 
1 

expressed  as 

=  *  &ijrJl4itN  *  iud 


(N.7) 


Its  inverse  is  denoted  as  Q^.  Specifically, 

Qss  =  [Ka  ]'•  (N.8) 

Finally,  let  x.'(n)  denote  the  value  assumed  by  the  random  vector  2L(n), 
n~l,2,...,N,  and  define  the  vectors 

[s’(n)]T  =  (x|(n)  xi(n)  ...  xj(n)]  (N.9a) 

and 

IS,'  ]T  =  { (s'(l)lT  [s'(2)]T...  [S'(N)]T1 .  (N.9b) 

The  complex  vector  ^  is  defined  to  be  Gaussian  if  and  only  if  its  density 
function  is  of  the  form 


W  ■  ((*)>%  J  ] exp  t  •  1si!n  -  Q*  fe,*  -  )  •  <N10) 


Alternatively,  one  could  focus  on  the  real  random  vectors  expressed  in 
eq(N.2).  It  is  convenient  to  combine  these  two  vectors  into  the  single 
concatenated  vector 


'Il,N  *<2l.N 


.]• 


The  mean  vector  of  [jj^]  is  given  by 


(N.ll) 


=  Gf,*  (N.12) 

The  JNxJN  covariance  matrices  pertaining  to  the  quadrature  components 
are  given  by 
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(N.13a) 


kL=  E(  UIltN  '  *iltN][*i1>N  ‘ 


KS  =  El  UqIiN  '  ^Qi.n^SQi.n  ' 

(N.13b) 

K«*~  El  [Sq1iN  •  -  Sl,^]T) 

(N.13c) 

KS  =  Et  tSlijsi  ’  5iIiN][5Q,j4  -  5q,j<]T)  • 

(N.13d) 

It  follows  that  the  2JNx2JN  covariance  matrix  of  (x1>N]  is 


Kjj  =  E{[Xi,n  ‘Xi^jKXi.n  'Xi^]T) 

i/iQ 
^xx  ^xx 

rrQl  irQQ 


(N.14a) 

(N.14b) 


Let  the  inverse  of  be  denoted  by  Q^;  ie., 

Qs  =  [Ka]‘.  (N.15) 

Observe  that  the  2JNx2JN  real  matrices  and  should  not  be  confused 
with  the  JNxJN  complex  matrices  and  which  were  defined  in  eqs(N.7) 
and  (N.8).  Finally,  lei  [£  '  ]  denote  the  values  assumed  by  the  random  variable 

[i,  js,]  with  quadrature  components  [&j1JS(]  and  suc^  ^at 

(N.i6) 

The  real  vector  £ljs,  is  defined  to  be  Gaussian  if  and  only  if  its  density  function  is 
of  the  form 
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Pt(i.',N)  = 


1 


[(2)t)2JNIK[Il  J2 


I  exp  { -2ti,'N  -  Iij«]T  Qfft,'_N  ‘  Ii.n]  }  (N17) 


By  4  lition,  p£(£  '  )  is  the  2JN -dimensional  multivariate  density  function 
1»N 

for  the  real  landom  variables  Xjjfk),  x2i(k),  ...,  xjj(k),  x^k),  x2q(k), ...,  xjQ(k) 
for  k  «  1,2,...,  N.  Also,  since  we  have  from  eq(N.5b) 

5,*'*ii.N  +  jSQw  <N-18> 

it  follows  that 


<N19> 

Thus,  the  NJ-dimensional  multivariate  density  function  for  the  complex  random 
variables  Xi(k),  x2(k) . xj(k),  for  k  =  1,2,...,N  should  also  be  equal  to  the  UN- 

dimensional  multivariate  density  function  for  the  real  random  variables  x^k), 
x2(k),...,  Xj(k),  for  k  ■  1,2,...,N.  This  g;*  os  rise  to  the  question,  "Must  certain 
conditions  hold  if  p-(j  '  )  given  by  eq(N.10)  is  to  equal  p£(i  '  ),  as  given  by 

eq(N.17)?“  By  inspection  of  the  two  equations,  it  is  apparent  that 


pa;n>  ■ 


(N.20) 


provided  the  following  two  equalities  are  met: 


1.1 


1 

[(it)JNIKMl  ] 


1 

[(2*)2JNIKUI  ]* 


(N.21) 


2-)  '  [&,*N  *  jsf]H  Q^[^i  N  *  “  ‘lUj  N  "  Xt,]T  ‘  (N-22) 
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EaualityJ 


Squaring  eq((N.21)  and  rearranging  terms,  equality  1  is  equivalent  to 


[det(K^)]2  =  (2)2JNdet(Kjj)  (N.23) 

where  the  notation  det(A)  replaces  IAI.  For  any  square  matrix  A,  it  is  known  that 
det(AT)  =  det(A).  (N.24) 

Therefore, 

detOCjj)  =  det(Kg).  (N.25) 

However,  as  pointed  out  previously,  is  Hermitian.  It  follows  that 

Kjj  =  %  (N.26) 

where  *  denotes  the  complex  conjugation  relation.  Consequently, 

detOCjj)  =  det(%)  (N.27) 

and  the  left  side  of  eq(N.23)  can  be  expressed  as 

[det(KM)]2  =  det(KB)det(%).  (N.28) 


Making  use  of  eq(N.5b)  and  (N.13)  in  (N.7)  and  substituting  the  results  into 
eq(N.28),  we  obtain 


(N.29) 


[detflCjj)]2  =  del[(K^ *0  +  j  (K&  •  K«)] 

•det[(K^+K^)-j(K^-K^)] 

Attention  is  now  focused  on  the  RHS  of  eq(N.23).  It  is  necessary  to 
express  det(K^)  in  terms  of  its  submatrices  ,  K^,  ,and  K1^.  For  this 

purpose,  the  following  properties  of  determinants  are  useful: 

P.r,op.srLl 

Given  square  matrices  A,  B,  and  C,  such  that  C  =  AB,  then 

det(C)  =  det(A)det(B).  (N.30) 

Property  2 

Having  partitioned  a  square  matrix  into  triangular  form,  where  the 
submatrices  are  all  square  and  of  the  same  order,  then  the  determinant  of  the 
matrix  equals  the  product  of  the  submatrices  on  the  principal  diagonal.  For 
example,  let  0,E,  F,  and  G  be  square  matrices  of  the  same  order  where  [0]  is  a 
null  matrix.  Then 


’  E  F' 
.[0]  G. 


) 


=  det(E)det(G). 


(N.31) 


With  properties  1  and  2  in  mind,  let  us  attempt  to  decompose  Kn  in  the 
form  shown  below. 


V-H  iflQ 
^XX  ^xx 


k 


QQ 


■  I  -jr 

■a  [or 

'  I  jl‘ 

-  [03  D  . 

.B  I  . 

.[0]  c. 

(N.32) 
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■  '"'-or 

!  -Vj-w  ?  -  -  *  rs^  *  -  • 


’v  .-Tpsgc  ? 

H;'H”^*  \i  « i  •  ■  *.-t-  -  ..7~  ,  r>*  I 


•  ■  iv.  '.- 

rat  .*  vJ 


ff  --:  i  ■.  £’'’  ^ .  —vr*  ’ j 


-S-*:6  -  ^ :.s«rfr. 

'  *  <*«»—*•  i  • '  ,  -  .'*-“  *+«•**% j,  a  -  "  -4... 


-  •-■  ^  -i  — .'  \ 


where  [0],  I,  A,  6,  C,  and  D  are  all  JNxJN  matrices,  [0]  is  a  null  matrix  and  I  is 
an  identity  matrix.  Recall  that 


det(I)  =  1. 


(N.33) 


If  the  decomposition  of  eq(N.32)  is  possible,  then 

detO^)  =  det(D)det(A)det(C)  (N.34) 


Carrying  out  the  matrix  product  on  the  RHS  of  eq(N.32),  we  have 


vn  vlQ 
n-XX  ^xx 


^xx 


■  A-jB  B+j(A-C)  * 
.  DB  D(C+jB)  . 


Equating  the  appropriate  submatrices,  there  results 

KXx  =  A  -  j  B 
K^  =  B  +  j(A-C) 

K^  =  DB 
K^  =  D(C+jB). 


(N.35) 


(N.36a) 

(N.36b) 

(N.36c) 

(N.36d) 


Solution  of  eqs(N.36)  for  the  matrices  A,  B,  C,  and  D  yields 
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(N.37a) 


A  =  K^  +  j(K^  +  j  k£)[K^  -  j  K®  ]''(K® ) 

B  =  (K^s  +  j  K^)[K^  -  j  K®]‘(K® ) 

C  =  (K^  +  jK^) 

D  =  [K^-jK®][K^  +  jK^]-'. 

Using  eqs(N.37)  in  eq(N.34),  it  follows  that 

det(Ke)  =  det  { [K^  -  j  K®  ][I&  +  j  K^j'1 } 

•  det{  +  j  [K^ + j  ii£][K^  -  j  K®  ]  ‘(K® ) } 
.det{[K^+jK'£]}.  (N.38) 

Examination  of  eqs(N.29)  and  (N.38)  reveals  that  equality  1,  as  expressed  by 
eq(N.23),  will  not  be  met  in  general.  The  equality  will  hold  provided 

KL  »  KS  (N.39a) 

and 

K®  =  -  k£.  (N.39b) 

Then  eq(N.29)  becomes 

[det(KH)]2  =  det[2(K^  +  j  K® )]  det[2(K^  -  j  K® )].  (N.40) 

Given  an  NxN  matrix  A  and  a  constant  k,  such  that  B=kA,  it  is  known  that 


(N.37b) 

(N.37c) 

(N.37d) 
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det(B)  =  det(kA)  =  kN  det(A). 


(N.41) 


It  follows  that  eq(N.40)  reduces  to 

[det(KB)]2  =  (2)aN  det[(K^  +  j  K® )]  det[(K^  -  j  K&)] .  (N.42) 

On  the  other  hand,  eq(N.38)  simplifies  to 

detOCjj)  =  det[(K^  +  j  K® )]  det^K^  -  j  K^)].  (N.43) 

It  is  concluded,  therefore,  that  equality  1  holds  provided  the  condition  of 
eqs(N.39)  are  valid.  Whether  these  conditions  are  sufficient  for  equality  2  to  also 
hold  is  now  investigated. 

Equality-2 

With  reference  to  eq(N.22),  equality  2  requires  that 

Qa[&,:N  •  si*]  ■  Kt,'iN  •  x,*r  •  iijdi-  (N-44) 

To  check  the  validity  of  this  equality  for  the  conditions  under  which  equality  1 
holds,  the  matrices  and  need  to  be  determined  for  the  special  case  of 

eqs(N.39).  We  can  express  the  covariance  matrix  on  as 

KM-(K2*+Kg)  +  j(K®-K£).  (N.45) 
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(N.46) 


Por  the  special  case  of  eqs(N.39),  simplifies  to 
K„-2(K^+jK®). 

Similarly,  the  covariance  matrix  on  glpN  ,  which  is  given  in  eq(N.14) 


«,n  „iq  “ 

»>xx  »>xx 

vQl  VQ0 

*>XX  ‘'JJ 


(N.47a) 


reduces  to 


(N.47b) 


Determination  of  is  facilitated  by  trying  to  find  matrices  Aj  and  A2 
such  that 

Qm  -  A,  -j  A2.  (N.48) 

Because  is  the  inverse  matrix  of  ,  it  follows  from  eq(N.46)  that 

Km  Qtt-2(K“n+i  K&K A ,  -J  Aj)  (N.4»«) 

m  2[(Km  A,  +  Aj)  +  J  (K^ji  Aj  •  Aj)]  ■  I  (N.49b) 


where  I  is  an  identity  matrix.  Equating  imaginary  parts, 
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(N.JO) 


2(K^  A|  •  Kjj  Aj)  ■  [0]. 

The  solution  for  Aj  yields 

Aa-tK^y'K^A,.  (N.J1) 

Equating  the  real  parts  of  eq(49b),  we  have 

2(kJj  A,  +  Aj)  ■  1.  (N.S2) 

Substitution  of  eq(N.51)  into  (N,52),  the  solution  for  A,  results  in 

A»  “i  *k2LIkJJ,  I'kSL  (N.J3) 

Using  eq(N,5 1 ),  it  follows  that 

Aj-tKar'K^A,  (N.S4») 

- 1  IkI^I  'kSL  {K^  +  K2i  [KJi»  j  'Kji  )•'  (N,34b) 

■  1  (  [kJI] 'KS»  )  1 1  Klll  +^2i  [kJJj  J  'kS  }''  (N,34c) 

r'K^lUKSir'C)]"  <N.34d) 

-  HKa  +  K^lKSHl  'Klj]'1.  (N,J4») 

From  matrix  theory,  it  is  known  that 

(A-')T  •  (AT)'.  (N.JJ) 
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Consequently, 


A7  - 1  { (K^f  +  (K2L)T ((C  ]  ')t(K«)t  )  '.  (N.J6) 

However,  from  eqs(N,39) 

(N.J7») 

(K^)T.K^-.Kji.  (N.J7b) 

It  ii  concluded  that 

a|  -  i  ( [Kjjj  J'k®)-1  -  A,.  (N.J8) 

A | .  therefore,  ti  a  symmetric  matrix.  Similarly. 

a!  - 1  [oOT+(C)T  ([KSI-JW]-  (N.J9.) 

•  •  HKM  +  K«  (KuI  'kJj  ]  -  -  a,,  (N.JSb) 

It  is  seen  that  A2  is  a  skew  symmetric  matrix,  And  so,  from  eq(N.48) 

Q|l*  Aj  -J  Aj,  (N,60a) 


-  j  { K'ii + Kjii  [kU*  ]''k21)-i-J  \  { k2i  +  (0'k„  )  (N.60b) 


Having  found  ,  attention  is  now  devoted  to  finding  Qft,  Por  this 
purpose,  let  Qg  be  partitoned  such  that 


337 


'■*&  \ff7 firim*  aipyfr 


£By&jr,-^.-i.znr 


■A3  a4* 

.  AS  A6. 


(N.61) 


where  the  submartices  A3,  A4,  A3,  and  A6  are  each  of  dimension  JNxJN.  From 
eq(N.14b),  we  have 


jfD  i/IQ 

»n  *v«t 
vQJ  t/QQ 


(N.62) 


Using  the  matrix  inversion  lemma  [95,  pg.  25],  eqs(N.61)  and  (N.62)  yield 


a3-  (kUj+k^ikUj  r'K^}’1 

(N.63a) 

a,  ■  {  + kJJj,  [KjjJ'kJu  }  ■' 

(N.63b) 

A,-,  t +  kJJj } ■' 

(N.63c) 

A  _  {  vt*  l** 

(N.63d) 

With  reference  to  the  expressions  for  A)  and  A2  ,  it  is  seen  that 


A,-2A, 
A4  -  2A, 
Aj  •  *  2A2 
Aa  •  2A|. 


It  is  concluded  that 


■  2 


’A,  V 

.  *A2  A..' 


(N.63a) 

(N.63b) 

(N.63c) 

(N.63d) 


(N.64) 
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Having  determined  the  matrices  and  Qg  ,  it  is  now  possible  to  evaluate 

the  quadratic  forms  in  eq(N.44).  Recall  that  [x  '  -  ^1N]  is  a  complex  JN- 

1 


dimensional  vector  given  by 


tSi'j.  -*uJ  ■  •  ii>u.+j  (5q,.n  •  5q> 


1.N 


(N.65) 


Therefore, 


=[(xl  -ir)  -j((xA  -x_)  .]T[A1.jAJ[(x;  -x.)  -  j  (xl  -  x~)  ]T 

LV“Il,N  1.N  J  V*QUSf  "Q  lJ^J  L  1J  2JLVAIi,N  —I  1 J4  J  ^Ql,N  *Q  1JT 

(N.66a) 

“  %i,N"^Il,N^  A*  ^Il,N**Il,fP  *  j  ^qijn’*Qi,iP  Al  %i,n’^Ii^ 

+  ^Ii,n’  *Ii,n^  ^Qi.n"  ^QijP  "  j  ^Qi,n’  *Qi  jP  Az  ^Qi,n'  *Qi,tP 

+  j  *Ii  jP  Al  *Qi  jp  +  ^Qi,n”  ^QijP  Aj  ^Qi,n”  ^Qij^ 

' j  <ti,y  *n/A2  hit?  ■  <*Quf  ^Qi/A2  <*h*  hit?'  (N-66b) 

Observe  that  each  term  in  eq(N.66b)  is  a  scaler  quantity.  Because  A,  is 
symmetric  and  the  transpose  of  a  scaler  equals  itself, 

%uC  *q>/a>  <«iu.-  »n*>  =  W  5i,/A>  *Q u?  (N'67a) 


=  (4i.^iii/A'%^W-  (R67b) 


Similarly,  because  A2  is  skew  symetric, 
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^Qi,n*  *QijP  ^2  ^Qi,n*  *Qi,n^  ”  ^Qi,n~  *QijP  ^Qi.n’ 

(N.68a) 

and 

"  ^Qi,n*  ^Qi  ,n'  *Qi,*P 

(N.68b) 

^Ium"  ^2  ^Ii,n’ 

(N.69a) 

^II JM~  ^2  ^IlJN’  *IlJ^  ‘ 

(N.69b) 

Since  a  scaler  can  equal  its  negative  value  only  if  the  scaler  is  zero,  it  follows  that 


%i*-WTa*<WW=0  (N70a) 

and 

<51,  *-  %ijC  *,|JN)  =  0.  (N.70b) 

Upon  substitution  of  eqs(N.67)  and  (N.70)  into  eq(N.66),  the  imaginary  terms 
cancel  and  we  are  left  with 

-  iitS1  = 

”  ^II ^  ^Ii,n'  *Il,N^  +  ^Ii,n’  ^Ql .N*  *QljP 

+  ^Qi,n*  *Qi.n^  ^  ^Qi,n’  *  ^Qi,n"  *Qi.n^  ^Ii jm’ 

(N.71) 

To  evaluate  the  quadratic  form  on  the  right  hand  side  of  eq(N.44),  recall 
that  Lt '  -i^]  is  the  2JN -dimensional  vector  given  by 

1  ,N 
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[^1  N  "iu^ 


As  a  result, 


-^Qi,n"  *QijP- 


(N.72) 


2^'n  = 


=  *[<WSi,/  (Sq^-Sq,/!2 

A1  A2 

-A„  A, 

_^Qi,n*  *QuP- 

-  ^Ii,n"  ^  %1.n’  *lljp  +  ^Ii,n’ 

^Qi.n’  *Qi,n^ 

(N.73a) 


a2  (s; 


Iij/  -Ii^  +  ^Qijm’  ^Qijn^ 


ai% 


-  2L->  )• 

1.N  -QiX 


(N.73b) 


Comparison  of  eq(N.73b)  with  (N.71)  reveals  that  equality  2  is  valid  under  the 
constraints  of  eq(N.45). 


In  summary,  by  definition,  the  probability  density  function  of  a  complex 
Gaussian  random  vector  is  given  in  eq(N.10)  whereas  that  for  a  real  Gaussian 

random  vector  is  given  by  eq(N.17).  Although  both  can  be  interpreted  as  the 
2JN-dimensional  multivariate  density  function  for  the  real  random  variables 

x n(k),  x2I(k),  ...,  xj!(k),  x1Q(k),  x2q(k),  ....  xJQ(k)  for  k  =  1,2,...,  N,  they  are 
not  equal,  in  general.  However,  for  the  special  case  in  which 
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(N.74a) 


and 


(N.74b) 


it  is  true  that 


PAV  =  P^.'n’ 


IX 


(N.75) 


Wide-sense  stationarity  of  the  bandpass  processes  is  of  particular  interest. 
As  shown  in  Appendix  O,  eqs(N.74)  are  satisfied  for  zero-mean,  wide-sense 
stationary  bandpass  processes.  Hence,  the  probability  density  functions 

and  p:(r  '  )  are  identical  for  a  wide-sense  stationary  bandpass  random  process. 
When  the  conditions  in  eq(N.74)  do  not  apply,  pf(r  '  )  represents  the  most 

general  situation  since 

pA;n)  *  Pi(t  ,*>■  (N.76) 
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APPENDIX  O  CONDITIONS  FOR  NARROWBAND  STATIONARY 

BANDPASS  PROCESSES 

In  this  Appendix,  we  derive  the  conditions  required  to  obtain  narrowband 
stationary  bandpass  processes.  In  section  0.1,  we  derive  these  conditions  for  the 
single  channel  case  while  in  0.2,  we  consider  the  multichannel  case.  Although 
the  presentation  in  0.1  was  independently  derived  in  [3],  a  very  similar  discussion 
appears  in  [164].  However,  we  are  not  aware  of  a  presentation  as  described  in 
0.2. 

0.1.  SINGLE  CHANNEL  CASE 

We  now  consider  a  real,  narrowband,  bandpass  process  nj(t)  such  that 

nj(t)  ■  Re[xj(t)exp(j27tfcit)]  (0.1.1) 

where  xj(t)  is  the  complex  baseband  process  previously  defined  in  eq(3.2.2)  as 

Xj(t)  ■  Xj,(t)  +  jxjq(t).  (0.1.2) 

The  quantities  Xjj(t)  and  Xjq(t)  are  the  real-valued  low  pass  quadrature 
components.  Using  eq(0.1.2)  in  (0.1.1),  the  process  nj(t)  can  be  expressed  in 

canonical  form  as 

njCt)  ■  Xj|(t)cos(2rtfCjt)  -  xjQ(t)sin(2rcfCjt).  (0.1.3) 

Taking  the  Hilbert  transform  of  eq(0.1.3)  and  recognizing  that  the  quadrature 
components  are  low  pass,  we  obtain 
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Ai(t)  *  xj!(t)sin(2irfcit)  +  xiQ(t)cos(27rfcit), 


(0.1.4) 


Eqs(0.1.3)  and  (0.1.4)  can  now  be  used  to  solve  for  the  quadrature  components 
resulting  in 

Xjj(t)  =  nj(t)cos(27tfCjt)  +  nj(t)sin(27rfC|t)  (0.1 .5a) 

and 

xiQ(t)  =  ni(t)cos(27tfc.t)  -  nj(t)sin(27tfc.t).  (0.1.5b) 

In  this  section,  we  will  determine  relationships  between  the  auto-  and  cross- 
correlation  functions  of  the  quadrature  components  of  the  process  x^(t)  under  the 

assumption  that  nj(t)  is  stationary.  In  this  case  the  correlation  function  of  n;(t)  is 
Rn^n^)  while  the  power  sper‘*'il  density  is  Sn.n.(f)  centered  about  ±  fc.. 

Dropping  the  redundant  subs  .  i  notation,  we  consider  the  Hilbert  transform  of 
n(t)  as 

oo 

n(t)  =  “J^dX.  (0.1.6) 

•OO 

The  cross-correlation  function  Rn^(t)  is  expressed  as 

Rnft(x)  =  E[n(t)n(t-T)].  (0.1.7) 

Substituting  eq  (0.1.6)  into  (0.1. 2.7) 
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Interchanging  the  expectation  and  integration 


on  the  bandpass  process. 


so  that 


Rnn(t-k)=E(n(t)n(X)] 


D  x_l  rRnn(t-^)  . 
®nn^  ”71]  t-x-X  ^ 


Now  let  a  a  t  -  X  so  that  dA.  =  -  da  and 


u  N  1  f  Knma)  . 

00 

OO 

_  1_  f  Rnn(a) 

~  7t  J  a-x  da 


1  f  Rnn(a'  a 

=  'tc  J  x-a  da  =  _Rnn(T)- 


Similarly, 


Rft„(x)  =  E[ft(t)n(t-x)J 


J1-  f"-^lidX 

K  t -K 

j 

•00 


(0.1.9) 


(0.1.10) 


(0.1.11) 


(0.1.12a) 


(0.1.12b) 


(0.1.12c) 


(0.1.13a) 


(0.1.13b) 
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ty, j  Taw : r.1*^  ">v,.tr*Se^Kr;  ,'_j  ~:'£.tr- t 


.1  rSMiMB!^ 


1  f  Rnn(^'t+T) 


_  1_  f  Rnn^ 

®JC  J  t- 


dX. 


-oo 


Let  a  =  X-t+x  so  that  dA,  =  da  and 


f  Rnn(a) 


x-a 


-da 


=  &nn(T) 


and  so  noting  the  equality  of  eqs(0.1.12c)  and  (0.1.14) 


•  Irmrwi 


(0.1.13c) 


(0.1.13d) 


(0.1.14) 


RnftCO  *  -  RfoW.  (0.1.15) 

Also,  at  x  ■  0  the  function  R^aJ/a  is  odd  so  that 

Rftn(0)  =  0.  (0.1.16) 

We  now  consider  the  correlation  functions  associated  with  the  quadrature 
components  defined  in  eq(0.1.5a)  and  (0.1.5b) 

R”(t)  «  E[xu(t)xa(t-X)]  (0.1.17a) 

=  E[n(t)n(t-x)]  cos(2rcfct)cos  (27ifc(t-x)] 

+  E[n(t)ft(t-x)]cos(27tfct)sin[2rcfc(t-x)] 

+  E[ft(t)n(t-x)]sin(27tfct)cos[27tfc(t-x)] 

+  E[n(t)ft(t-x)]sin(2ffct)sin(27cfc(t-x)].  (0.1.17b) 
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Let 

A  =  2jtfct 
B  =  27tfc(t-T). 

Using  the  identities 
cos(A  -  B)  *  cosAcosB  +  sinAsinB 
sin(A  -  B)  a  sinAcosB  -  cosAsinB 
we  obtain 

cos(2jrfct)cos[27cfc(t-x)]  =  cos(2jtfcx)  -  sinAsinB 
cos(2jtfct)sin[27tfc(t-T)] «  cosAsinB 
sin(2rfct)cos[27tfc(t-t)]  =  sinAcosB 
sin(27tfct)sin[27rfc(t-x)]  =  sinAsinB. 

Using  these  relations  and  eqs(0.1.14)  and  (0.1.15)  in  (0.1.17b) 
Rjj(x)  =  Rnn(x)[cos(27rfcx)  -  sinAsinB] 

-ftnn(x)cosAsinB  +  ftnn(T)sinAc03B 

+  R(\ft(x)sinAsinB 
=  Rnn(x)[cos(27tfcx)-sinAsinB] 

+  ftnn(x)(sinAcosB-cosAsinB] 

+  RftftCOsinAsinB 
*  Rnn('c)[cos(27rfcx)-sinAsinB] 

+  ftnn(x)sin(27tfcx) 

+  R|\^(x)(sinAsinB]. 

In  Appendix  P  and  [3],  we  show  that 

+  Rnn(x) 

so  that 


(0.1.18a) 

(0.1.18b) 

(0.1.18c) 
(0.1. 18d) 

(0.1. 18e) 
(0.1.18f) 

(0.1. 18g) 

(0.1. 18h) 


(0.1.19a) 


(0.1.19b) 


(0.1.19c) 

(0.1.20) 
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Similarly, 


Rjj(x)  »  Rnn(t)cos(2jcfct) 

+  ftnn(T)sin(27cfc,c). 

Rii  (x)  *  Rnn(T)co8(27rfcT) 

+  ftnn(x)sin(27rfcx) 


so  that 


We  now  consider 


(0.1.21) 

(0.1.22) 

(0.1.23) 


R^(x)  -  E(nI(t)nQ(t-x)]  (°* 1  -24a) 

«E[n(t)ft(t-x)]cos(2jrfct)co8(27tfc(t-x)] 

+  E[i\(t)ft(t*x)]sin(27tfct)cos[27cfc(t-x)] 

-  E(n(t)n(t-x)]cos(27Cfct)sin(27cfc(t-x)] 

-  E[ft(t)n(t-x)]sin(27rfct)sin[27tfc(t-x)]  (0. 1 .24b) 

■  Rn^(x)cosAcosB  +  Rflfl(x)sinAcosB 

-Rnn(x)c°!»  AsinB  -  R  j\n(x)»inAslnB  (0. 1 .24c) 

■  Rnfl(x)cosAcosB  +  Rnn(x)8inAcosB 

-Rnn(x)C08AsinB  -  R^xJsinAsinB  (0. 1 .24d) 

where  eq(O.l.20)  was  used  to  in  the  second  term  above.  From  eq8.(0.1.12c)  and 
(0.1.14) 

Rnft(t)--ftnn«  (0.1.25a) 

Rftn(t)  ■  ftnnW  (0.1.25b) 


|Q 

Ril(t)»  Rnn(^)lsinAc°f  B  •  cosAsinB] 

•  &nn(t)(cosAcoiB  +  sinAninB]  (0. 1 .26a) 

■  Rnn^iinCA  -  B)  •  ftim(t)co»(A  -  B)  (0.1.26b) 

*  Rnn(t)iin(27rfct)  -  ft|m(T)coi(2«fct).  (0. 1 ,26c) 

Similarly, 

•  R$(t)  ■  Rnn(x)sin(2*fcx)  -  ftnn(x)coi(2»rfcT)  (0. 1 ,27d) 

so  that 

(0.1.27c) 

Wc  also  note  that  since  Rnn(x)  even  and  lnn(x)  is  odd,  then  eq(0.1  26c) 

|Q 

indicates  that  Rjj (t)  is  odd,  It  was  noted  at  the  end  of  chapter  3,  that  the 
stationary  narrowband  process  is  a  special  case  which  results  in  odd  cross* 

|Q  Q| 

correlation  quadrature  components  Rjj(t)  and  Rjj (x). 

0.2.  MULTICHANNEL  CASE 

We  now  consider  two  real,  narrowband,  bindptss  processes  nj(0  and  nj(t) 

defined  in  eq(O.l.l)  and  develop  properties  similar  to  those  developed  In  the 
previous  section,  Specifically,  we  will  determine  relationships  between  the  cross* 
correlation  functions  of  the  quadrature  components  involving  Xj(t)  and  xj(t);  ie„ 

II  QQ  QI  IQ 

R|j(x),  Ry  (x),  Rjj(t)  and  R{j(x).  The  bandpass  processes  are  expressed  as 

nj(t)  ■  Re[x|(t)exp(J27tfC|t)]  (0,2,1a) 

and 

nj(t)  *  Re[xj(t)exp(j2nfcjt)].  (0,2, 1  b) 
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In  Motion  4,3,2,  however,  we  suggested  that  each  ehannal  process  can  ba 
translated  to  a  common  rafaranca  frequency  fC||,  And  10,  fCJ  and  fCj  in  (0,2,1) 

can  ba  raplacad  with  fCR,  Eq»(0.2,l)  can  than  ba  expressed  ai 

nj(t)  ■  Ra(x|(t)aap02nfCftt)l  (0,2.2a) 

and 

nj(t)  ■  Re(xj(t)exp(J2rtfCj|t)),  (0.2,2b) 

Using  tha  quadrature  form  for  x§(t)  and  xj(t)  expressed  in  aq(3,2.2),  wa  obtain 
the  canonical  foimi  for  tha  above  equation*  ai 

nj(t)  ■  X||(t)coi(2nfCj|t)  •  xjQ(t)*ln(2nfC||t)  (0.2,3a) 

and 

nj(t)  •  xj,(t)co*(2nfCjt)  ■  xjg(t)*in(2«fCjlt).  (0,2,3b) 


Tha  Hilbert  traniform  of  nj(t)  is  expresMd  a* 


Assuming  wlde-sense  Joint  itationarity  batwian  tha  two  hindpm  procanai,  tha 
cross-correlation  function  Rn^(t)  ii  expressed  a* 

R„|ft.(T)  -  B|n|(i)ftj(t-t)|,  <0.2.  J) 

Substituting  «q  (0,2,4)  Into  (0,2,9) 


Rn,A/*>  ■  q 


1 

n  J  t-t-X 


dX 


(0,2,6) 
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Interchanging  the  expectation  and  integration 


(0.2.7) 

We  now  consider, 

Rnjnjd-^)  *  EIn|(t)nj(X» 

(0.2.8) 

ao  that 

"nifty's  j  "rfr  <*" 

•M 

(0.2.9) 

Now  let  a  ■  t  •  X  10  that  dX  ■  -da  and 

1  f  **nin/a) 

Rn(ftj(t> "  «  J  ~ST~  (-da) 

(0.2.101) 

1  (  Rnm/a) 

■«J  at-da 

•** 

(0.2.10b) 

i  * 

■  •  *■  *— ■ da 

n  J  x*a  uw 

•M 

(0.2.10c) 

(0.2.  lOd) 

Similarly, 


^fljnjW  "  K|ft|C,)nj(t-x)J 


(0.2.11a) 


’’  -  ^gpz-rrr  -  ,-,Jr^.-i.~...r. 


ft*r  wwi.  3V5»*«  v  ,'  *m 


lj^dx 

m 


1  f  E[nj(X)nj(t-T)] 

5  J - I3T — < 


(0.2.11b) 


(0.2.11c) 


1  f  ^njnj^t+x^ 
n  j  t-X  c 


Let  a  ■  X*t+x  so  that  dA,  *•  da  and  eq(0.2.1  Id)  becomes 


1  f  R>>inj(a) 

—  - J - ( 

n  J  x-a 

-M 


From  eqs(0.2.10d)  and  (0.2.12b),  we  have 


MjW  "  *%/*>• 


(0.2.1  Id) 


(0.2.12a) 


(0.2.12b) 


(0.2.13) 


We  now  consider  the  cross-correlation  functions  associated  with  the 
quadrature  components  of  the  Xj(t)  and  xj(t)  processes  defined  in  eqs(0.2.5a). 

First,  consider 


Rjj(t)  -  E(xj|(t)xjj(t-x)]. 


(0.2.14) 


Using  eqs(0.2.3a)  and  the  corresponding  Hilbert  transforms  of  eq(0.2..4),  we 
solve  for 
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Xji(t)  ■  ni(t)cos(2jrfCRt)  +  ni(t)sin(27cfCRt)  (0.2. 15a) 

and 

xi0(t)  *  ni(t)c°s(27cfc  t)  -  ni(t)sin(2Tcfc_t).  (0.2.15b) 

Using  eq(0.2.15a)  and  the  corresponding  equation  for  xjj(t)  in  eq(0.2.14),  we 
obtain 

R^iCc) »  E[n;(t)n;(t-x)]cos(27cfc  t)cos[27tfc  (t-x)] 

J  VR  WR 

+  E[nj(t)nj(t-x)]cos(27cfc  t)sin[27cfc  (t-x)] 

*  R  R 


+  E[nj(t)nj(t-x)]sin(27tfc  t)cos[27tfc  (t-x)] 

~  R  R 


+  E[nj(t)nj(t-x)]sin(27cfc  t)sin[2jtfc  (t-x)]. 

(0.2.16) 

We  now  define 

A  =  2rcfCRt 

(0.2.17a) 

and 

B  =  27tfCR(t-x). 

(0.2.17b) 

Let  us  recall  the  identities 

cos(A  -  B)  =  cosAcosB  +  sinAsinB 

(0.2.18a) 

sin(A  -  B)  s  sinAcosB  -  cosAsinB. 

(0.2.18b) 

Using  eq(0.2.18a),  we  have 

cos(2jrfCRt)cos[27tfCR(t-x)]  =  cos(27ifCRx)  -  sinAsinB.  (0.2.19) 
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From  the  identities  defined  above, 


cos(27cfCRt)sin[27tfCR(t-x)]  =  cosAsinB 
sin(2TcfCRt)cos[2itfCR(t-x)]  =  sinAcosB 
sin(2itfCRt)sin[2jtfCR(t-x)]  =  sinAsinB. 


Eq(0.2.16)  can  now  be  written 

Rij(x)  =  Rn.nj(T)[cos(27tfCRT)  -  sinAsinB] 

+  R_  a  (x)cosAsinB 

ninj 

+  R^._.(x)sinAcosB 
ninj 

+  RAA.(x)sinAsinB 
ninj 

=  Rn.nj(x)[cos(27tfcrx) '  sinAsinB] 

+  R_. -.(^[sinAcosB  -  cosAsinB] 

“inj 

+  Ra  A  (x)sinAsinB 

ninj 

where  we  have  used  eqs(O.2.10d)  and  (0.2.12b)  to  obtain 
Appendix  P  and  [3],  we  show  that 

^njnj(x)  =  ^njnj(T^  • 

Using  this  equation  and  the  identity  expressed  in  eq(0.2.l8b), 
RijOO  *  Rninj(x)cos(27tfCRx)  +  ftn.n.(x)sin(2irfCRx). 


(O.2.20a) 

(O.2.20b) 

(0.2.20c) 


(0.2.21a) 

(0.2.21b) 
(0.2.21b).  In 

(0.2.22) 

(0.2.23) 
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Similarly,  using  the  relation  sin(A-B)  =  -sin(B-A),  we  obtain 


Rif  CO  =  Rn.nXt)cos(27rfCRt)+  ftniI1j(T)sin(27tfCRt) 
so  that 

n  QQ 
Rij(x)  =  R -j  (x). 


Next,  we  consider 

Rf(t)  =  EtxjjWxjQrt-T)]. 


(0.2.24) 

(0.2.25) 


(0.2.26) 


Using  eqs(0.2.15a)  and  the  j  channel  equivalent  of  eq(0.2.15b)  in  (0.2.26),  we 
obtain 


Rij  (x)  =  E[niu)nj(t-x)]cos(2^fCRt)cos[27CfCR(t-x)] 

+  E[hi(t)nj(t-x)]sin(27rfCR0cos[2jrfCR(t-x)] 
-E[ni(t)nj(t-x)]cos(27tfCRt)sin[27rfCR(t'X)] 
-E[ni(t)nj(t’X)]sin(27rfCRt)sin[2rrfCR(t-x)] 


=  RnA.(x)cosAcosB  +  R(\.^.(x)sinAcosB 
i  J  ^  J 

-  Rn.n.(x)cosAsinB  -  Ra  n  (x)sinAsinB 
t  J  i  j 


=  Rn.A  (x)cosAcosB  +  Rn.n.(x)sinAcosB 
i  j  ^  J 

■  Rn  n  (T)cos^s^n®  ‘  R^.n.(^)sinAsinB 
^  J  i  j 


(0.2.27  a) 
(0.2.27b) 


(0.2.27c) 
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where  eq(0.2.22)  was  used  in  the  second  term  above.  Using  eqs.(O.2.10d)  and 
(0.2.12b)  in  (0.2.27c) 


Rjj  (x) «  Rninj(x)(sinAcosB  -  cosAsinB] 

-  ftj^xXcosAcosB  +  sinAsinB) 

■  Rninj(t)tln(A  •  B)  -  ftniflJ(t)coi(A  •  B) 

■  Rninj(T)»in(2nfCR[)  - 

Similarly, 

Rjj  (x)  ■  E[xiQ(t)xji(t-t)] 

■  E(fti(t)nj(i-t)]cos(2rtfCRt)cos[2JcfCR(t-T)J 

+  E[fti(Oftj(t*x)]co8(27tfCRt)iln[27tfCR(t.x)] 

-  E[nj(t)nj(t*x)]sin(2rtfCRt)cos(27cfCR(t*x)) 
•E(ni(t)ftj(t-t)]sin(2rtfCRt)sinl2«fCR(t.x)l 

-  Rftinj(x)cosAcosB  +  RftjftjWcosAslnB 

“  Rnjnj(T)*inAcolD  *  Rniftj(T)|inAllnB 

*  Rft.n.(T)co*AcosB  +  Rnjnj(x)C0lA,*nB 

-  Rn,nj(x)sinAcosB  •  Rn^(x)sinAsinB 

«  ftnjnj(x)tCORAcosB  +  sinAsinB] 

'  Rnjnj(T)ls*nAc08B  ’  cosAsinB] 

-  ftninj(x>C08(27tfcRx)  ‘  Rninj(x)sin<27cfcRx) 

so  that 

IQ  Qi 

Rjj(x)  »  -  R  ij(x). 


(0.2.28a) 

(0.2.28b) 

(0.2.28c) 


(0.2.29a) 


(0.2.29b) 

(0.2.29c) 

(0.2.290) 

(0.2.29e) 

(0.2.290 

(0.2.30) 
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APPENDIX  P  DERIVATION  OF  EQS(O.1.20)  AND  (0.2.22) 


In  thii  appendix,  we  prove  that 

Rfl1Aj(T)  “  Rnjnj(t)  forUj  »nd  i  e*  j  (P.l) 

where  the  lymbol  a  in  this  discussion  refers  to  the  Hilbert  tranform.  Consider 


E|ft|(t)njtt))  -  E 


Let 
Slid 
10  that 


ci  *  t  *  X 
P  -  0  -  X 


(P.2c) 

(P.3a) 

(P.3b) 

(P.3c) 

(P.4») 
<  P.4b) 
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(P.5a) 


oo 


Etfti<t)njO.)]  =  £ 


Sjj»> 


-dp 


t-p-X 

•OO 


Using  eq(P.5b)  in  (P.2c),  we  have 


These  results  also  hold  when  i  *  j. 


(P.5b) 


(P.6a) 


(P.6b) 

(P.6c) 
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APPENDIX  Q  DERIVATION  OF  EQ(4.3.2a) 


In  this  appendix,  we  derive  eq(4.3.2a).  Using  1=0  in  eq(4.3.1b)  together 
with  the  definition 


V0)  ■  • 


we  obtain 


Solving  eq(Q.2)  for  the  normalizing  coefficient 

_(p«u>V«ll 

K,|J  ta  i-i  )l  exp('JV0>l 
V^nc'  Vi«o 

so  that  eq(4.3.1b)  becomes 


Rgjj(l) 


f~(X  II  )l  exp(J(%(l)  •  V0)1}- 
~Ta  i  ,  i  cxp(J(Vt)]  1  g  *  •* 

fg(Agjj,  I  •  iglj)l|.o  J 


where,  by  definition  [3], 

PI(J  ■  lP*Ul®’'PU0,y<O>l 


We  alto  have 


(Q.l) 


Rgij(°)  “  (p*u)a*ii%  *  ,",*ij)li«OCxp{j0gij(O)}*  «*2> 


(Q.3) 


(Q.4i) 


(Q.4b) 


(Q.3) 


%<!)  -  (Rfu(-0)# 


(Q.6i) 
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(Q.6b) 


«  (P,|l>  q8H°giif<(X|ii’  exp  ( -j[8,  (-D-e,  (0)] } . 

UK,,  l-l.jl.-n  IJ  J 


Ipo. *  I  ”  Iffu) 

gi)  <»i  *JJ  g  -gJ L - ^-exp(-j  [0g{i(*Ol )  g  -  s»c. 

fg^gij’  ^  *  ^8iy  l“0 


(Q.6c) 


Eqs(Q.4)  and  (Q.6)  provide  us  with  a  useful  description  of  the  cross- 
correlation  function  in  terms  of  the  cross-correlation  coefficient  Pg.j.  the  standard 

deviations  alt  and  ?jj  of  the  channel  i  and  j  processes,  respectively,  and  the 

temporal  cross-correlation  coefficient,  Xg^. 

For  the  autocorrelation  function  (i*j),  we  have 


since  any 


*Pgjj*  *  * 

given  channel  process  is  totally  correlated  with  itself  at  zero  lag. 


(Q.7) 

Also, 


V0)=0 


(Q.8) 


ilnce  0,  (I)  la  an  odd  function  of  I .  Eq(Q.4b)  for  the  autocorrelation  function 
now  becomes 


%(') 


fg(X|^,  I  )^ |— o 


■«xp{j(Ogu(l»} 


(Q.9) 


where  we  again  note  that  lg  »0  for  1-J  since  the  autocorrelation  function  peaks  at 
lag  zero.  Furthermore,  since  the  function  fg(-)  for  the  autocorrelation  function 
has  a  peak  value  of  unity  at  1**0,  eq.(Q>9)  reduce*  to 


(Q.IO) 


At  I  •  0,  rq,(Q. 10)  becomes 


R*ii<°>  “  °*il 


g"S,C 


(Q.ll) 


which  is,  as  expected,  the  variance  of  the  zero  mean,  channel  i  process. 
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APPENDIX  R  SPECTRA  FOR  COMPLEX  CORRELATION 

FUNCTIONS 

In  this  appendix,  we  derive  relationships  between  the  auto-  and  cross¬ 
spectra  and  their  associated  complex  auto-  and  cross-correlation  functions.  In 
particular,  we  consider  the  shaping  forms  of  the  correlation  functions  discussed 
in  section  4.3. 

R.l.  GENERAL  RELATIONSHIPS 

The  power  spectral  density  P|j(0  of  the  continuous  random  process  X|(t)  is 

defined  as  the  Fourier  transform  of  its  autocorrelation  function  such  that 


jR|i(T)eXp(-j2TCfT)dT 


(R.l) 


while  for  the  discrete  processes  xj(n),  we  use  the  discrete  Fourier  transform 


Pjl(f)  -  T  X  Ri,(l)exp(.J2*flT) 


(R.2) 


where  x((t)  is  assumed  to  be  bandlimited  to  t  Hz,  and  Pji(f)  is  periodic  in 
frequency  with  period  ^  Hz. 

The  cross-power  spectrum  P|j(f)  of  two  processes  X|(t)  and  Xj(t)  is  similarly 

expressed  in  terms  of  the  cross-correlation  functions  such  that  for  continuous 
processes 

M 

P(J<f)  -  fR|jU)«isp(-J2itft)dt,  (R.3) 


Aiiumlng  x,(t)  and  x.d)  lo  hr  bridllmlled  10  t  j*T  Mi,  die  dlicrele  I’ourlcr 
transform  foi  the  discrete  pioceisos  results  in  tlte  cross-power  spectrum 
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Py(0  -  T  £Ry(l)exp(.J2nflT). 

|«.M 

Using  the  property  of  autocorrelation  function!;  ie., 

(R.4) 

R(l(t)  -  Ri’(-T) 

(R.5) 

in  «q  (R.l),  w«  h»v« 

M 

P||(f)  ■  J* Ru  ( -T)exp<  -J  2«fx)dT 

•M 

(R.6a) 

M 

■  jRjl(T)exp(J2rtft)dt  -  (P41(O)0 

•M 

(R  ,6b) 

j 

1 

where  the  last  equality  reiult*  by  changing  the  verieble  t  to  *t  end  appropriately 
changing  the  direction  of  the  integration.  Similarly,  using  eq  (R.3)  In  eq  (R.2) 
provides  the  discrete  time  version  as 

P||(0  ■  T  YR|*|(.!)«xp<.J2nnT) 

(R.7*) 

00 

-T  ^R,1(l)cKp(+J2nflT)-|P|,(f)l*. 

|««M 

Equations  (K.6b)  and  (R.7b)  indicate  that  the  autospectra  are  real, 
general 

(R,7b) 

Sine*,  in 

Hjj(t)  b  kJ(.t) 

(KJa) 

and 

Rgil)bRj(.l) 

(K.«b> 

36.1 


the  croii-ipactra  li,  in  fanaral,  complex.  Fro. .» tha  Fourier  inversion  formula, 
we  have 


R»|(T)  ■  JP4,(f>#Kp(j2nfT)df 

•M 

(R.*») 

and 

M 

Rij(T)  ■  Jpy(0#xp(J2ftft>af 

(R.W 

•90 

for  continuous  lima  processes;  (ha  inverse  dlicraia  lima  Fourier  traniform  ylaldi 

a 

R|i<l)  ■  JPj|(f)axp(J2nf!T)df 

(R.tOa) 

*5t 

and 

1 

RV(D  ■  Jp^OmpUSHflDdf. 

(R,10b) 

At  t  •  0,  aq»  (R,9i)  and  (K,9b)  become 

Rii<0)  -  |PH(f)<lf 

(RMi) 

•R 

and 

M 

Ky(0)  ■  jFylDdf 

•  M 

(R.llb) 

fur  conllnuoua  lime  piocaiieii  for  M),  eqi  (R.lQa)  end  (K.lOb)  become 


(R.12») 


R||(0)  •  |P||(Odf 

and 

Ry(0)  - 

for  discrete  time  processes. 


(R.  12b) 


R,2  QUADRATURE  COMPONENT  FORM 

We  now  consider  (he  continuous  complex  autocorrelation  function  in  termi 
of  id  quadrature  components,  such  (hit 

Rj|(T)  -  Rqt(t)  *►  JRpti(t),  (R,13) 


Using  eq  (R.13)  in  eq  (R.l),  we  have 

M  M 

P|,(0  ■  jRcu(t)exp(-J2nft)dt  ♦  j  jRpj((t)exp(-J2nfT)dT,  (R.I4) 

•M  «M 

Rut  since  Rcu(t) 11  *nd  Rp^t)  odd  (see  section  3.2),  eq  (R.l 4)  becomes 


P„(0  ■  jRCjj(t)cos(2Rft)dT  4-  jRPj((i)sin(2«ft)dT 

•  Pct|<0  4 


'll' 


(R.l  5a) 


(R.l  5b) 


Bq(R.I3b)  indicates  (hat  the  autospectrum  is  real,  as  noted  previously. 

Since  the  first  integral  is  an  even  function  of  f  while  (he  second  is  odd,  (he 
resulting  spectrum  is  not.  In  geneial,  syrnmet  1c  about  f«0.  In  the  case  where 


Pp4J(0  ■  0,  the  spectrum  is  even.  This  results  when  Ri).i(x)»0,  so  that  Rjj(x)  is 
real. 


R.3  SPECTRAL  DISTRIBUTION  USING  THE  CORRELATION 
SHAPING  FUNCTIONS 

We  now  present  a  discussion  which  will  help  to  clarify  the  role  of  the 
temporal  correlation  coefficient  X}|  introduced  in  section  4.3  to  shape  the 

autocorrelation  function. 

R.3.a.  Spectrum  of  the  Gaussian  Shaped  Autocorrelation  Function 
In  this  case,  we  consider  a  real  autocorrelation  function  for  a  continuous¬ 
time  process  on  channel  i  and  eqs(4.3.8)  are  used  with  the  subscript  notation  g 
dropped.  Specifically, 

6||(t)*0  (R.16a) 

and 

f(Cjj/0  *  tj2  ■  exp  (*2?i2n?jT2)  (R.16b) 

where 

III  ■  exp(-2*2pu).  (R.17) 

With  these  expressions 

2  2 

R||(t)  •  a*ltexp(-27t2nuT2)  (R.18) 

is  a  real,  Gaussian  shaped  autocorrelation  function.  Taking  the  derivative  of 
eq(R.l)  with  respect  to  f  and  cq(R.9a)  with  respect  to  t,  we  have 


fyi(0  ■  Jl-J2«tRu(t))exp(-J?.nfT)dT 


(R.19a) 


(R.19b) 


oo 

Rii(T)  =  J027rfPii(f)]exp(+j27cft)df. 

-OO 

Therefore, 


F  T  * 

-j2jcxRii(t)  ^  Pa(f) 


and 


Rii(x)^  j2jtfPu(f) 


where  ^  denotes  the  Fourier  transform  pair.  Taking  the 
eq(R.18)  with  respect  to  x 

Ru(x)  =  -  4n2  pjx  Rii(x) 
so  that  from  eq.  (R.20b) 

-47t2p?iX  Ru(x)  ™  j27xfPii(f>- 


2  . 


Dividing  both  sides  of  (R.22)  by  -j27tpjj  yields 


-j27txRll(x)  ^ 


f ' 
Hii 


Pa(f). 


Using  eq.  (R.20a)  and  eq.(R.23) 


Pi|(f)  »  * 


r  f  i 

PH 

*  m 


P||(0. 


(R.20a) 

(R.20b) 

derivative  of 

(R.21) 

(R.22) 

(R.23) 

(R.24) 


367 


fi2H5 


4.::2£±r5HE£ 


Solving  this  equation  for  Pj^f),  we  obtain 


Pu(f)  =  P  (O)exp(-  f2/2|ifj) 


(R.25) 


where  it  is  now  observed  that  is  the  variance  of  the  Gaussian  power  spectral 

density  function.  Eq(R.25)  indicates  that  the  real,  Gaussian  autocorrelation 
function  results  in  a  symmetric,  Gaussian  power  spectral  density  (PSD). 

For  the  discrete  time  case,  x— »IT  where  T  is  the  sample  period,  so  that 


Rjj(l)  =  <J,..exp(-2itVlT2|2) 
=  as^l2 


(R.26a) 


(R.26b) 


where 


Xii  »  exp(-27t2piiT2). 


(R.26c) 


From  eq(R.26b),  we  see  that  as  the  variance  of  the  power  spectrum  \L[[  ranges 

from  zero  to  infinity,  X^  goes  from  one  to  zero,  repectively.  For  Xjj=0,  Rj^l)  is  a 
discrete  delta  function  5(1)  and  Pjj(f)  is  a  white  noise  spectrum.  When  X^  =  1, 
Rjj(l)  denotes  the  case  of  total  temporal  correlation  with  a  periodic  line  spectrum 

2 

for  Pjj(f)  which  results  from  the  Poisson  sum  formula  using  Rii(l)=as..  in  eq(R.2). 

For  Xjj  ranging  from  zero  to  unity,  all  values  of  temporal  correlation  are 
obtained.  Thus,  X^  is  a  measure  of  the  temporal  correlation  between  consecutive 
samples  of  the  random  processes  [23]. 

R.3.b.  Spectrum  of  the  Exponential  Shaped  Autocorrelation  Function 
In  this  section,  we  consider  a  real  exponential  autocorrelation  function  for 
a  continuous  time  process  on  channel  i.  For  this  case,  we  have 


0ii(x)  =  0 


(R.27a) 
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(R.27b) 


f^.x)  =  CiT  1  =  exp^TtKy  I  x  | ) 

where,  in  this  case 


tu  =  expC^tCy). 

With  these  expressions,  we  have 

(R.28) 

Rii(T)*oJiiexp(-2icKiiiT|) 

(R.29) 

The  power  spectral  density  is  determined  by  considering 
superposition  of  two  functions  such  that 

RjiCx)  as  the 

Riitt  =  0sV'u(t)  +  Os^uf-T) 

(R.30) 

where  u(x)  is  the  unit  step  function.  And  so,  the  power  spectral  density  is 
expressed  as 

oo 

C  2 

Pjj(f)  =  las..exp(-2jtKjit)exp(-j27cfT)dt 

0 

0 

C  2 

+  J  as..exp(+27CKiix)exp(-j27cfx)dx 

(R.31a) 

-OO 

2  2 
°sii  % 

=  (2jtKjj)  +  j(2jtf)  +  (2jtK,j)  -  j(2itf) 

2c^.(2itKii) 

"  (27tKji)2  +  (2xcf)2  ' 

(R.31b) 

(R.31c) 

The  peak  value  of  this  function  occurs  at  f=0  so  that 
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(R.32) 


Also 


Pii(O) 


2 


TCKii* 


2 

<*s 


Pu^^ii)  “  2rtKu 


(R.33) 


so  that  the  3-dB  down  points  occur  at  f  =  in  the  exponential  case.  The 

V3 

inflection  point  of  P^f)  occurs  at  f  = 

A  similar  presentation  can  be  made  for  the  discrete-time  case  using 

fOii.1)  =  Xi 1 1  =  exp(-2itKilT  ill)  (R.34) 

where,  in  this  case 

=  expC^TCKiiT).  (R.35) 
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